-- Logs begin at Tue 2022-06-21 09:17:44 UTC, end at Tue 2022-06-21 10:17:26 UTC. -- Jun 21 09:44:38.730366 dv-cinder-806605-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 09:44:38.739524 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 09:44:38.742104 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 09:44:38 2022] *** Jun 21 09:44:38.742239 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 09:44:38.742346 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 09:44:38.742450 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: nodename: dv-cinder-806605-4-iscsi Jun 21 09:44:38.742545 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: machine: x86_64 Jun 21 09:44:38.742657 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: clock source: unix Jun 21 09:44:38.742758 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: pcre jit disabled Jun 21 09:44:38.742857 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: detected number of CPU cores: 4 Jun 21 09:44:38.742995 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: current working directory: / Jun 21 09:44:38.743098 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: detected binary path: /usr/bin/uwsgi-core Jun 21 09:44:38.743205 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: your processes number limit is 47680 Jun 21 09:44:38.743300 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: your memory page size is 4096 bytes Jun 21 09:44:38.743929 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: detected max file descriptor number: 2048 Jun 21 09:44:38.744104 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: lock engine: pthread robust mutexes Jun 21 09:44:38.744274 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: thunder lock: enabled Jun 21 09:44:38.744449 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 09:44:38.744528 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 09:44:38.787517 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: Python main interpreter initialized at 0x55a0a19099c0 Jun 21 09:44:38.787517 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: python threads support enabled Jun 21 09:44:38.787517 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: your server socket listen backlog is limited to 100 connections Jun 21 09:44:38.787517 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: your mercy for graceful operations on workers is 90 seconds Jun 21 09:44:38.787835 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 09:44:38.787930 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: *** Operational MODE: preforking *** Jun 21 09:44:38.788218 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: *** uWSGI is running in multiple interpreter mode *** Jun 21 09:44:38.788218 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: spawned uWSGI master process (pid: 80059) Jun 21 09:44:38.788408 dv-cinder-806605-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 09:44:38.789291 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: spawned uWSGI worker 1 (pid: 80068, cores: 1) Jun 21 09:44:38.789291 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: spawned uWSGI worker 2 (pid: 80069, cores: 1) Jun 21 09:44:38.789435 dv-cinder-806605-4-iscsi devstack@keystone.service[80059]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 09:44:44.214938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:44:44.214938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: from cryptography.utils import int_from_bytes Jun 21 09:44:44.215670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:44:44.215670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: from cryptography.utils import int_from_bytes Jun 21 09:44:44.215901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:44:44.215901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: from cryptography.utils import int_from_bytes Jun 21 09:44:44.216386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 09:44:44.216386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: from cryptography.utils import int_from_bytes Jun 21 09:44:44.264149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 09:44:44.264344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 09:44:44.264539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] command line args: [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 09:44:44.264812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 09:44:44.264993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ================================================================================ {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 09:44:44.265075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 09:44:44.265225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 09:44:44.265308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] admin_token = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.265421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] command line args: [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 09:44:44.265505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] config_dir = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.265656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.265736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 09:44:44.265837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] config_source = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.265919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ================================================================================ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 09:44:44.266015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] debug = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] admin_token = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_dir = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] config_source = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.266932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] debug = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_config_append = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.267947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_dir = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_file = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_config_append = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_dir = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.268919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.269927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.270963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.271948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] publish_errors = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] publish_errors = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.272991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] standard_threads = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.273897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.274013 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.274641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.274767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] use_journal = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.274843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] standard_threads = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.274944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] use_json = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] use_stderr = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] use_syslog = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_journal = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.275815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_json = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.275928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_stderr = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.276025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.276131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] use_syslog = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.276246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.276366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 09:44:44.276484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.276622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.276732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.276864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.276968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.277940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.278900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.279853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.280850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.281971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.282925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.283944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.284910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.285970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.286976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.287891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.288993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.289099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.289224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.289343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.289452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.289529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.289713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.290413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.290493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.290558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.290734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.290816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.290964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.291907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.292970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.293907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.294860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.295953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.296931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.297037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.297174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.297280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.297534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.297778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.297929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.298946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.299947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.300948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.external = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.301921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.external = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.password = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] auth.token = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.302842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.password = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] auth.token = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.303955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.304996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.305156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.305234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.306989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.307998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.308869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.309982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.310955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.311995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.312952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.313905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.314836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.315988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.316922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.317934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.318902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.319843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320256 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.320987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.321935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.322958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.323909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324079 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.324882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.325963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.326972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.327931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.328892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.329994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.330940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.331959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.332935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.333906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] role.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334763 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] role.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.334991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.335948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.336101 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.336218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.336296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.336464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.336554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.337970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338534 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.338937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.339896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.340906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.341991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.342939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.343949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.344928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.345085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.345162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.345329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.345406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.345839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.345924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.346871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.347820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.connection = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.348854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.349976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.350997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.351940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.352113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.352202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.352918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.353000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.353156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.353234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.353325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 09:44:44.353412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.353620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.353858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 09:44:44.354031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 09:44:44.384093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.384322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.384547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.385070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.385304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.385531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.393121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.394115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.421389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.421615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.422515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.422749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.564208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.564405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.613190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.613377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.614222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.614460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.677333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.677559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.677784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.677867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.678939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.703485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.703721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.703945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.704870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.705013 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.705234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.705453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.716431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.717125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.729228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.729461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.729688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.729808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.729892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.730934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.731149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80069) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 09:44:44.748206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.748417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 09:44:44.748740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.748822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.748937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 09:44:44.749031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 09:44:44.749202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.749283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.749460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.749540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 09:44:44.749715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.749798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.749967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.750047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.750225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.750485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.760815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.761092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.761360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.761441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.761643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.761737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.761925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.762207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.769950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.770504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.773264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.773544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.773822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.773901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.774636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.774721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.774913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.774993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.775954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.776053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.776247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.776336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.776509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.776587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.776781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.777048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.803362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.804201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.805001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.805298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.805846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.806126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.810541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.810936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.811217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.811535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.811930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.812240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.818509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.818790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.819541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.819824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.823309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.823597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.823878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.824186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.824393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.824487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.824679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.824760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.824963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.825044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.825231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.825312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.825509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.825780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.826049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.826313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.844456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.844741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.845839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.846124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.849586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.850782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.853289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.853693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.854508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.854906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.858715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.859945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.862350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.863637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.866012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.866308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.866589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.866872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.867150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.867262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.867428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.867562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.868400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.868699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.868979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.869255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.887533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.887813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.888101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.888382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.888876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.889170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.889440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.889711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.896257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.897634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.897966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.898241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.899581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.899866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.901599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.901875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.902154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.902432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.902708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.903103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.903385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.903671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.903951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.904259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.915965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.916259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.916543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.916823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.917559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.917843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.918128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.918340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.918422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.918634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.918940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.919945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.920269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.920573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.937381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.939016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.940692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.942349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.944005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.945690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.945772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.947938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.948055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.948250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.948529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.949623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.949903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.950187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.955901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.957535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.957617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.959163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.960784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.961075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.961467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.961771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.962476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.962770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.963162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.963440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.971164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.971447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.971735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.972846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.973142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.973423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.979625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.979904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.980211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.980487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.980758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.981136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.981381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80069) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 09:44:44.981462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.981661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.981743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.981943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.982845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.983022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.983131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.983288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.983416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.983693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.983992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.984273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.984547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.984831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:44.985094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80069) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 09:44:45.021935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a0a19099c0 pid: 80068 (default app) Jun 21 09:44:45.024087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a0a19099c0 pid: 80069 (default app) Jun 21 09:44:45.025505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde1a37-c243-48aa-99d1-377c2456f1a7 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:45.025807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde1a37-c243-48aa-99d1-377c2456f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:45.026163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde1a37-c243-48aa-99d1-377c2456f1a7 None None] PATH_INFO: `/v3` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:45.031290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue Jun 21 09:44:45 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:44:52.606435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:52.606991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:52.606991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:52.611276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:44:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:44:52.616947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:52.617362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:52.617629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:52.688483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: INFO dbcounter [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] Registered counter for database keystone Jun 21 09:44:52.709871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG oslo_db.sqlalchemy.engines [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:44:52.716351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writer thread running {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:44:52.893606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG passlib.handlers.bcrypt [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80068) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 09:44:52.893928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG passlib.handlers.bcrypt [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80068) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 09:44:52.948037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:44:52.949622 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:44:53.066972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:44:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 09:44:53.215501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:53.285040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: INFO dbcounter [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] Registered counter for database keystone Jun 21 09:44:53.303581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG oslo_db.sqlalchemy.engines [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 09:44:53.310236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writer thread running {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 09:44:53.427953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22edb-bbe2-430b-a598-eb1607303701 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:53.432301 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:53.432948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:53.433233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:53.433508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:53.441494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:53.493203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 09:44:53.493543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea85b1fd-b6ce-43ed-ac0b-1326cde27475 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:53.502814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jun 21 09:44:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 09:44:53.509280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:53.523462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac524075-7f7a-4f57-84b4-97e338185c43 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:53.528464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:53.529588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:53.529874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:53.530150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] PATH_INFO: `/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:53.534232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] RBAC: Authorizing `identity:get_project(project_id=7f168e0b349b4ecc9d941ccf0785ad5d)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:53.583657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 09:44:53.584024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1493f-39eb-4d8f-8c5e-59c7f02e5e3e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:53.589122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue Jun 21 09:44:53 2022] GET /identity/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:44:55.562037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2950a6-7d3f-487d-8ccf-ebb160d72fcd None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:55.562554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2950a6-7d3f-487d-8ccf-ebb160d72fcd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:55.562649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2950a6-7d3f-487d-8ccf-ebb160d72fcd None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:55.566674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:44:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:44:55.572561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:55.572941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:55.573121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:55.591524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:44:55.593098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:44:55.601188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:44:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 09:44:55.623210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2950a6-7d3f-487d-8ccf-ebb160d72fcd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:55.635545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2950a6-7d3f-487d-8ccf-ebb160d72fcd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:55.639672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cd469-2c66-44c7-9691-1b0dd0a7f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:55.640320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd469-2c66-44c7-9691-1b0dd0a7f01d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:55.640604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd469-2c66-44c7-9691-1b0dd0a7f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:55.640879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cd469-2c66-44c7-9691-1b0dd0a7f01d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:55.648364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cd469-2c66-44c7-9691-1b0dd0a7f01d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:55.650157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cd469-2c66-44c7-9691-1b0dd0a7f01d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:55.658655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Jun 21 09:44:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 09:44:55.663654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:55.672901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bdf8d-9e30-4c23-a1bf-a537b444d4a4 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:55.677253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f1568-3c12-4d48-b183-96d105b62898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:55.678096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1568-3c12-4d48-b183-96d105b62898 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:55.678381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1568-3c12-4d48-b183-96d105b62898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:55.678658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f1568-3c12-4d48-b183-96d105b62898 admin admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:55.680057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f1568-3c12-4d48-b183-96d105b62898 admin admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:55.681906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f1568-3c12-4d48-b183-96d105b62898 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:55.683452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue Jun 21 09:44:55 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:44:57.729259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abf050-3d85-4fef-b34e-4157de4866ac None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:57.729765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abf050-3d85-4fef-b34e-4157de4866ac None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:57.729834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abf050-3d85-4fef-b34e-4157de4866ac None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:57.731189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:44:57.736355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:57.736769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:57.736920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:57.753903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:44:57.755078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:44:57.785243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243cb6e-df95-4a68-9f03-bf941d60df43 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:57.785527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243cb6e-df95-4a68-9f03-bf941d60df43 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:57.785804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243cb6e-df95-4a68-9f03-bf941d60df43 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:57.787155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:44:57.792247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:57.792534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:57.792813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:57.832714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG passlib.handlers.bcrypt [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80069) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 09:44:57.833124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG passlib.handlers.bcrypt [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80069) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 09:44:57.836949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:44:57.860518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:57.878979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:44:57.880608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:44:57.890837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:57.969709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720f52b-4e01-458f-9f9e-543bc767801c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:57.980504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:44:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:44:58.002479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.003305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.004145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.004433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.004714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.016520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:44:58.028268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:44:58.029253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:44:58.030094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:44:58.035036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.105982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52192dfb-2605-497d-bb8a-6349117b1a27 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.108403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:58.120108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:58.138664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2ba50-ed42-4eeb-8e28-fd03b7bf8b6e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.145634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.146533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.146820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.147104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.173199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.173858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.174144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.174422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.175177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:44:58.175487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.176926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.188979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:44:58.194424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.213681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.215223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.291550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996f232-1960-47e9-819c-baf68cd1a25e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.311297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:44:58.316851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.319390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:58.324813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.325692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.325976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.326255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.327468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.328955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.330579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:44:58.335789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.350969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:58.416661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038044d5-6287-4bf0-9093-677d2310c3b6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.439595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934ea2c-59e7-49ae-8fbe-fec7e73026ae None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.460562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.462722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.463035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.463316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.473082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.473862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.474144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.474420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.475581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.477674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.479273 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 10/18] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:44:58.482834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.484337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.484862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:44:58.507059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:44:58.508029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:44:58.508884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:44:58.508884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:44:58.508884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:44:58.508884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:44:58.508884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 9/19] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:44:58.514878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:44:58.561431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:58.570633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:44:58.580636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba2f0-1e44-4cf7-8aa1-6175d4b108c6 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.614400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.614557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5dc34-065f-4207-8306-d0c987208ea5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:44:58.615044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.615323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.615595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.616450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.domain.id=default, user.id=80104af4696c44369cc93327cb4e59bd) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:44:58.616754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.618202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de2b27-f66e-4e1a-a31b-332b42c4303b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.624938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/role_assignments?user.id=80104af4696c44369cc93327cb4e59bd&scope.domain.id=default&role.id=7adf0608488a4c0780e809cd640a911c => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:44:58.649402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:44:58.650099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:44:58.650391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:44:58.650675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:44:58.651430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:44:58.651746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:44:58.653241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515335-719b-4317-8bfc-7181aa4a8c6d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:44:58.673053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:00.940324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0391-2d65-4099-b2b4-60d985a34c9d None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:00.940825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0391-2d65-4099-b2b4-60d985a34c9d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:00.941094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0391-2d65-4099-b2b4-60d985a34c9d None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:00.942706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:00.948149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:00.948945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:00.949413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:00.977565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:00.979110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:01.025406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17aed-339d-408d-861c-ec3e234a4d6f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.026024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17aed-339d-408d-861c-ec3e234a4d6f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.026524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c17aed-339d-408d-861c-ec3e234a4d6f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.032395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 13/23] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:01.037863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b2ef-76e0-4708-9c51-1247479fb8a8 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.038439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b2ef-76e0-4708-9c51-1247479fb8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.038919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b2ef-76e0-4708-9c51-1247479fb8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.072979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6895b2ef-76e0-4708-9c51-1247479fb8a8 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:01.073332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:01.074857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6895b2ef-76e0-4708-9c51-1247479fb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:01.111891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:01.201127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:01.205544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:01.250254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9660-926a-4c0b-92df-d82c86ff736b None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.250558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9660-926a-4c0b-92df-d82c86ff736b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.250835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f9660-926a-4c0b-92df-d82c86ff736b None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.252410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 15/26] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:01.257870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.258167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.258491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.281132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:01.282645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:01.300890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b731f81-9632-4f73-9d0c-99a4825571db None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:01.371114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:01.372268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.372750 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.373207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.391033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 16/27] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:01.391897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:01.396143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:01.405161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:01.406733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:45:01.435131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:01.435957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:01.436788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:45:01.436788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:45:01.436788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:45:01.436788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:01.436993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 12/28] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:01.437596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:01.586974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e399-25c3-47e4-b35d-20eeba1856ec None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:01.624432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac741499-50df-4ecb-97a9-28672b519468 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:01.626130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:01.642550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:01.643600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.644380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.644666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.657473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:01.665503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:01.666318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:01.667056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 17/29] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:01.667668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d39a9-172f-4645-a304-448704718a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:01.667757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:01.668356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d39a9-172f-4645-a304-448704718a4b None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.668514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d39a9-172f-4645-a304-448704718a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.671996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d39a9-172f-4645-a304-448704718a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.671996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d39a9-172f-4645-a304-448704718a4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:01.672723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d39a9-172f-4645-a304-448704718a4b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:01.739768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:01.780759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f28563-dc92-4563-a5f5-11f418817bce None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:01.817428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:01.818230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.818613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.818991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.819855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:01.820297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:01.821808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e76154-1f64-4845-b324-40d98d3a453f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:01.840604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 18/30] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:01.842013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86c5c-5b18-46eb-b19c-0b5a8307dd44 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:01.842208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 13/31] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 09:45:01 2022] POST /identity/v3/roles => generated 219 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:01.842590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86c5c-5b18-46eb-b19c-0b5a8307dd44 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:01.843208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d39a9-172f-4645-a304-448704718a4b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:01.843957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86c5c-5b18-46eb-b19c-0b5a8307dd44 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:01.848956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 19/32] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:01.858216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86c5c-5b18-46eb-b19c-0b5a8307dd44 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:02.049030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d39a9-172f-4645-a304-448704718a4b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.061619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86c5c-5b18-46eb-b19c-0b5a8307dd44 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.098282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:02.105175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:02.105871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.106164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.106447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.107217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:02.107532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:02.109530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626351-c733-4908-9477-00ab9ac004e4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:02.117670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:02.118679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.119180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.119702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.121255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:02.123354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:02.123966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 14/33] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:02.125617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.128362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.128863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.150014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:02.153813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:02.173312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:02.240449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 15/34] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:02.241617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:02.318705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 20/35] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:45:01 2022] POST /identity/v3/projects => generated 301 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:02.322222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:02.353968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef91ee-d055-488e-8a67-09f30b7830c0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.393253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:02.394502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.394991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.395470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.397539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:02.399304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:02.401456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 16/36] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:02 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:02.409075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:02.435815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:02.436020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41894-c61f-426f-b6bc-78f2db74844e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.474234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a326aa3-63f7-4f1e-b73f-ea8efa462736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:02.474942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326aa3-63f7-4f1e-b73f-ea8efa462736 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.475231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326aa3-63f7-4f1e-b73f-ea8efa462736 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.475517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326aa3-63f7-4f1e-b73f-ea8efa462736 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.476323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a326aa3-63f7-4f1e-b73f-ea8efa462736 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:02.478502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a326aa3-63f7-4f1e-b73f-ea8efa462736 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:02.498838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 21/37] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 09:45:02 2022] POST /identity/v3/roles => generated 225 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:02.505712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ccb61-0ac7-45bc-851d-b16833b111d8 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.507469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ccb61-0ac7-45bc-851d-b16833b111d8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.507999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ccb61-0ac7-45bc-851d-b16833b111d8 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.513006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 22/38] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:02 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:02.521592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.521904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.524477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.555702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:02.558304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:02.574349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7387342e-4e77-45d8-9757-69c6e0456e31 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.618789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:02.619515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.619797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.620152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.622532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:02.623870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:02.625645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 17/39] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:02.630235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:02.631457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:02.694358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 23/40] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:02.721306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:02.749161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:02.764794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2114f-d194-4d68-a4fb-c8e0069f1ddd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.805771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851d68-411a-42be-bc92-c6e1eded9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:02.806718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851d68-411a-42be-bc92-c6e1eded9601 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.806948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851d68-411a-42be-bc92-c6e1eded9601 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.807238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851d68-411a-42be-bc92-c6e1eded9601 None admin] PATH_INFO: `/v3/domains/default/users/80104af4696c44369cc93327cb4e59bd/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.809475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39851d68-411a-42be-bc92-c6e1eded9601 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=80104af4696c44369cc93327cb4e59bd, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:02.810958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39851d68-411a-42be-bc92-c6e1eded9601 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:02.827134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 18/41] 10.222.0.36 () {58 vars in 1361 bytes} [Tue Jun 21 09:45:02 2022] PUT /identity/v3/domains/default/users/80104af4696c44369cc93327cb4e59bd/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:02.828529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035447-8412-470d-877d-c66ce378b202 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.828825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035447-8412-470d-877d-c66ce378b202 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.829108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035447-8412-470d-877d-c66ce378b202 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.830575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 19/42] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:02.836478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:02.836773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:02.837059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:02.848221 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848dd78-744d-43f8-a0c7-04a229d47c89 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:02.856554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:02.857840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:02.938144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 20/43] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:02.962342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:03.010014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:03.010690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:03.010981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:03.011266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:03.012047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:03.013456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:03.027501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 24/44] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 09:45:02 2022] POST /identity/v3/roles => generated 223 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:03.057926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:03.088963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95053ea6-4e54-4f34-ba36-7ff7c60e2a6a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:03.128511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd4692-5b1c-4d8d-b3b3-016512cce94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:03.129334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4692-5b1c-4d8d-b3b3-016512cce94f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:03.129611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4692-5b1c-4d8d-b3b3-016512cce94f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:03.129888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd4692-5b1c-4d8d-b3b3-016512cce94f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:03.131113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd4692-5b1c-4d8d-b3b3-016512cce94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:03.132624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd4692-5b1c-4d8d-b3b3-016512cce94f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:03.135057 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 21/45] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:03.140541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:03.171042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:03.246842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe75ee-2acc-4d05-adc2-90dcadbf0870 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:03.281367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d673a8-db86-40cf-948c-d2cb6b7ac398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:03.282035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d673a8-db86-40cf-948c-d2cb6b7ac398 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:03.282320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d673a8-db86-40cf-948c-d2cb6b7ac398 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:03.282598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d673a8-db86-40cf-948c-d2cb6b7ac398 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:03.283333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d673a8-db86-40cf-948c-d2cb6b7ac398 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:03.284849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d673a8-db86-40cf-948c-d2cb6b7ac398 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:03.312422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 25/46] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:45:03 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:04.901853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae976-1c39-414b-b1b6-17464a9377b6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:04.902363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae976-1c39-414b-b1b6-17464a9377b6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:04.902447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ae976-1c39-414b-b1b6-17464a9377b6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:04.903806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 22/47] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:04.908966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:04.909399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:04.909529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:04.925938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:04.927111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:04.993470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:05.017139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae976-1c39-414b-b1b6-17464a9377b6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.114850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ae976-1c39-414b-b1b6-17464a9377b6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.147609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6c9dc-d88a-4f59-897a-9fa9329b3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.148427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6c9dc-d88a-4f59-897a-9fa9329b3fbb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.148711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6c9dc-d88a-4f59-897a-9fa9329b3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.149016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6c9dc-d88a-4f59-897a-9fa9329b3fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.159892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6c9dc-d88a-4f59-897a-9fa9329b3fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-62f6c9dc-d88a-4f59-897a-9fa9329b3fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:05.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:05.169586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:05.170414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 23/49] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:05.176998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.187655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:05.275193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a2626-9ce0-42e0-b794-96ec98c114e6 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.311838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.312542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.312832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.313116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.313880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:05.314193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:05.315591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:05.324148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e196c9-4ca6-474d-9f30-978278133249 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.324448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e196c9-4ca6-474d-9f30-978278133249 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.324596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 27/50] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:05.324730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e196c9-4ca6-474d-9f30-978278133249 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.326096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 24/51] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:05.329979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.330816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.331109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.331393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.338322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:05.348892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:05.350099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:05.397318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:05.416290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 25/52] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:05.427808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca4c61-60b8-4b1d-9b4c-557364f0e1ea None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.439933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.461252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.462105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.462388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.462665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.463857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:05.465332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:05.466957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 28/53] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:05 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:05.472410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.542053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b3ff9-7d75-4805-b8c8-fc0e33767439 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.572755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8194-385a-45f4-8728-b727266231f3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.610133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.610943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.611229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.611535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.612815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:05.614314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:05.616036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 29/54] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:05.621943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.631166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:05.680125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.680821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.681102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.681374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.682525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:05.683956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:05.685582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 26/55] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:05.690925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:05.693479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:05.724806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348be12-a3f2-455f-a6f8-ccb9c5d522a5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.759215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.759867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.760183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.760467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.761298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.domain.id=default, user.id=80104af4696c44369cc93327cb4e59bd) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:05.761612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:05.763048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c53ee2-daa8-4466-8a2e-76947dbdccd7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:05.768809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 30/56] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Jun 21 09:45:05 2022] GET /identity/v3/role_assignments?user.id=80104af4696c44369cc93327cb4e59bd&scope.domain.id=default&role.id=7adf0608488a4c0780e809cd640a911c => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:05.790066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325d469-ec89-431e-b83d-4cfb5efb5e0a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:05.828038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222322e-80e8-444f-8855-6d5e7a021654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:05.828721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222322e-80e8-444f-8855-6d5e7a021654 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:05.829008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222322e-80e8-444f-8855-6d5e7a021654 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:05.829289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222322e-80e8-444f-8855-6d5e7a021654 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:05.830012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222322e-80e8-444f-8855-6d5e7a021654 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:05.831477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222322e-80e8-444f-8855-6d5e7a021654 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:05.860137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 27/57] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jun 21 09:45:05 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:45:07.914849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b5a0-2578-4ebb-a815-0c1f0547d0b9 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:07.915359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b5a0-2578-4ebb-a815-0c1f0547d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:07.915437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25b5a0-2578-4ebb-a815-0c1f0547d0b9 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:07.916798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 31/58] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:07.921876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:07.922231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:07.922447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:07.938857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:07.940093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:07.993044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:08.011224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:08.035351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25b5a0-2578-4ebb-a815-0c1f0547d0b9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:08.103470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:08.135161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25b5a0-2578-4ebb-a815-0c1f0547d0b9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:08.167692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6535fa-6738-4fb2-b5f1-de6fced28799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:08.168448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6535fa-6738-4fb2-b5f1-de6fced28799 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:08.168733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6535fa-6738-4fb2-b5f1-de6fced28799 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:08.169009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6535fa-6738-4fb2-b5f1-de6fced28799 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:08.170167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6535fa-6738-4fb2-b5f1-de6fced28799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:08.171605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6535fa-6738-4fb2-b5f1-de6fced28799 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:08.173252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 32/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:08.178653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:08.277725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7e55e-e8a6-4117-973e-49ad171fcb33 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:08.311207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f983ef9-81a3-40db-90fd-3add87a458b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:08.311875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f983ef9-81a3-40db-90fd-3add87a458b2 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:08.312191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f983ef9-81a3-40db-90fd-3add87a458b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:08.312472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f983ef9-81a3-40db-90fd-3add87a458b2 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:08.313193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f983ef9-81a3-40db-90fd-3add87a458b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:08.314642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f983ef9-81a3-40db-90fd-3add87a458b2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:08.341024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 29/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:08 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:45:11.280682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3fda4-2678-4620-b20a-02279658a23c None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.281688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3fda4-2678-4620-b20a-02279658a23c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.282203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3fda4-2678-4620-b20a-02279658a23c None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.283771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 33/62] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:11.288945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.290285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.290761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.311051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:11.312553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:11.356005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:11.397886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:11.434322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3fda4-2678-4620-b20a-02279658a23c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:11.568917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3fda4-2678-4620-b20a-02279658a23c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:11.615551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a5231-2935-4fb6-a4d6-2d09b177c51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:11.616309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5231-2935-4fb6-a4d6-2d09b177c51b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.616599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5231-2935-4fb6-a4d6-2d09b177c51b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.616879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a5231-2935-4fb6-a4d6-2d09b177c51b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.627820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a5231-2935-4fb6-a4d6-2d09b177c51b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:11.636942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-335a5231-2935-4fb6-a4d6-2d09b177c51b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:11.641714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:11.642541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:11.643289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:11.644365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 34/64] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:11.649784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:11.768331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef99f52-41ad-4787-a952-debf50bef59c None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.768629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef99f52-41ad-4787-a952-debf50bef59c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.768903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef99f52-41ad-4787-a952-debf50bef59c None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.770984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 35/65] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:11.777819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986be7-312a-49ea-9f8c-e6fe4bb8cce4 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.778112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986be7-312a-49ea-9f8c-e6fe4bb8cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.778399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3986be7-312a-49ea-9f8c-e6fe4bb8cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.799774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d3986be7-312a-49ea-9f8c-e6fe4bb8cce4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:11.801943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d3986be7-312a-49ea-9f8c-e6fe4bb8cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:11.803565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2ceb3-6a9d-4028-bcac-ca75d085fb99 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:11.841003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:11.841674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.841957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.842230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.842984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:11.843287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:11.844701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cb926-00b4-4d3a-a13a-7133d5e821b9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:11.854780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 31/66] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:11.856169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094491-a84c-4d40-b091-52a04018741a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.856486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094491-a84c-4d40-b091-52a04018741a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.856843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9094491-a84c-4d40-b091-52a04018741a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.858340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 32/67] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:11.863359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094491-a84c-4d40-b091-52a04018741a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:11.887664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 36/68] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:11.889225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:11.889663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:11.890087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:11.910687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:11.918324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:11.920539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:11.992053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 37/69] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:11.993670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.006323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9094491-a84c-4d40-b091-52a04018741a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.043253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9228194-64b8-43ee-be93-179a046b6b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.044164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9228194-64b8-43ee-be93-179a046b6b33 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.044450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9228194-64b8-43ee-be93-179a046b6b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.044725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9228194-64b8-43ee-be93-179a046b6b33 None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.058616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.063157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9228194-64b8-43ee-be93-179a046b6b33 None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.064754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9228194-64b8-43ee-be93-179a046b6b33 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.071276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 33/70] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:11 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.071276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba5e0-a7db-4e4a-ba3e-b0d75010fba6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.071276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba5e0-a7db-4e4a-ba3e-b0d75010fba6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.071276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba5e0-a7db-4e4a-ba3e-b0d75010fba6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.071276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 34/71] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:12.071276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba5e0-a7db-4e4a-ba3e-b0d75010fba6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.111787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d996f-d577-4748-9232-b8c3fb56dc6c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.147750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.148520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.148843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.149125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.159048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:12.165862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:12.167843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:12.168778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 38/72] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:12.174469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.182893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bba5e0-a7db-4e4a-ba3e-b0d75010fba6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.218373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3086e-2390-4690-b2ff-66f9bfd6f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.219161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3086e-2390-4690-b2ff-66f9bfd6f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.219450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3086e-2390-4690-b2ff-66f9bfd6f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.219732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3086e-2390-4690-b2ff-66f9bfd6f5f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.230712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3086e-2390-4690-b2ff-66f9bfd6f5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a5e3086e-2390-4690-b2ff-66f9bfd6f5f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:12.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:12.239290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:12.240328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 35/73] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:12.241196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ce1-88ab-41d1-a5c0-7ae3cbe2037b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.241196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ce1-88ab-41d1-a5c0-7ae3cbe2037b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.241323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9ce1-88ab-41d1-a5c0-7ae3cbe2037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.256930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2b2b9ce1-88ab-41d1-a5c0-7ae3cbe2037b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:12.258708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2b2b9ce1-88ab-41d1-a5c0-7ae3cbe2037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:12.268527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fdb4a-347d-4748-8420-6f9af9c6a8b7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.285050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.302494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.303145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.303432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.303715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.324817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 36/74] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:12.326215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6071-c44e-4eff-8e33-3954756eaa24 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.326582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6071-c44e-4eff-8e33-3954756eaa24 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.326931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc6071-c44e-4eff-8e33-3954756eaa24 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.328304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 37/75] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:12.329001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6071-c44e-4eff-8e33-3954756eaa24 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.377005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.378484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.409469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.430973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc6071-c44e-4eff-8e33-3954756eaa24 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.463519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.464195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.464476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.464752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.465493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:12.465801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.467179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb48c3a-f6a6-498f-9e25-35c749fe6f19 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.475234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:12.475348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 38/77] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.480578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.480731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.480731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.480731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.494581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:12.495764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:12.497258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.563285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:12.564174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.580274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d60d93-4624-4bc8-932b-557619623d1a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.615456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.616153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.616439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.616714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.617484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:12.617791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.619154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.627073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.627834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.634583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.664166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3763-31d8-4263-ac15-0f9b4d704c2e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.697718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.698504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.698789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.699068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.700273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.701722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.703496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 40/80] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.704098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.710864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.732573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be91b9-f73e-4d6a-a5bb-a57bf45b43b8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.765571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.766463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.766749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.767020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.768247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.769691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.771386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 41/81] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.772156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.805310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8240a-9b18-44c1-b548-d5e9418f031b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.838286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.839153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.839443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.839725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.840962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.842400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.844061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 41/82] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.844819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.855503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.870859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eadd7c-6d8c-4e78-8a02-e230bf896c14 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.904660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.905448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.905732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.906008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.915845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:12.923464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:12.924447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:12.925191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 42/83] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:12.926172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:12.936869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:12.947025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced80f-fbae-4a45-9ef0-86ae85344b23 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:12.980580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:12.981444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:12.981838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:12.982120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:12.983313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:12.984775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:12.986397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 42/84] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:12.987146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.024955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d3856-86f1-42ac-842f-28b3a60c8cc3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.060868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.061533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.061818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.062107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.062241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.063255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.064951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.085575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162de5e3-ecf9-4823-bd79-d8806c1fedf0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.093208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 43/85] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:12 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:13.097067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.134910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.135581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.135868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.136183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.137032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=c88fdfdb752649fdb268dae651ed0b98) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:13.137348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.138841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.147287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 43/86] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:12 2022] GET /identity/v3/role_assignments?user.id=c88fdfdb752649fdb268dae651ed0b98&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=423552284f2a4983b5eef8fc699e5515 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:13.148232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.199349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.263658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562c034-d97c-497e-a3f1-5a28d9055073 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.296855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f08e62-7fbe-4979-9075-6fe8b65cb5cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.313746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.315215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.315506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.315785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.338977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.339840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.339943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.340230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.341306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:13.341626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.343268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.353971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:13.354890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.359865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.400596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.402572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.477217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbb73-c666-4fba-a4d9-932123e8192f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.489626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.526329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.527143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.527546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.527834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.542177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 44/88] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:13.543782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.617910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.620339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.622992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.682602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983c2e-e4de-4d02-9533-5103189d620b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.727368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.728711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.729309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.729778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.731185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.733001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.735509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 45/89] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:13.741032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.777802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:13.779772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:13.797984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.932566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a914161-d846-41b5-bd62-a3e1dab172ca None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.955047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec8b91-d212-4ca0-b9e0-19869393ea7a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:13.957517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:13.982207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:13.982976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:13.983262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:13.983544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:13.984828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:13.986292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:13.988044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 46/91] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:13.988900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:14.021034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:14.022023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:14.022524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:14.023015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:14.159024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:14.160553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:14.180547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76f54-7f71-4db9-9d2c-dfaa57b5044f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:14.183377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:14.247018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:14.248946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:14.250025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:14.250317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:14.253469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:14.254924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:14.256657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 47/92] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:14.262023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:14.318367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 46/93] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:14.319257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:14.321557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:14.426669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bca04-710e-4ca1-8bef-4cc45368c437 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:14.462781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:14.463447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:14.463735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:14.464033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:14.464881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=80104af4696c44369cc93327cb4e59bd) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:14.465194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:14.466654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:14.472731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:14 2022] GET /identity/v3/role_assignments?user.id=80104af4696c44369cc93327cb4e59bd&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:14.473646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:14.478993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2107-854c-475a-a5ad-dffdb3e08bc3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:14.551321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:14.561629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:14.562309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:14.562598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:14.562878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:14.563737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] RBAC: Adding query filter params (role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=c88fdfdb752649fdb268dae651ed0b98) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:14.564150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:14.565619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:14.578947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 48/95] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:14 2022] GET /identity/v3/role_assignments?user.id=c88fdfdb752649fdb268dae651ed0b98&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:14.595341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab076b-835e-4475-907e-9b2719810fc1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:14.634442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979cd45-9c92-4e2a-a382-08db32bfcba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:14.635573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979cd45-9c92-4e2a-a382-08db32bfcba2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:14.636033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979cd45-9c92-4e2a-a382-08db32bfcba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:14.636452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979cd45-9c92-4e2a-a382-08db32bfcba2 None admin] PATH_INFO: `/v3/projects/19c5b83802fe424184341375d3eccf4a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:14.637823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979cd45-9c92-4e2a-a382-08db32bfcba2 None admin] RBAC: Authorizing `identity:get_project(project_id=19c5b83802fe424184341375d3eccf4a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:14.639581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979cd45-9c92-4e2a-a382-08db32bfcba2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:14.642430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 48/96] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:14 2022] GET /identity/v3/projects/19c5b83802fe424184341375d3eccf4a => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:14.648547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:14.696174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:14.766775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab794-d5ea-4b6f-b90a-81e6000ddb96 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:14.803505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:14.804129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:14.804424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:14.804704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:14.805680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=19c5b83802fe424184341375d3eccf4a, user.id=c88fdfdb752649fdb268dae651ed0b98) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:14.805993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:14.807448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369b416-e2fa-48b9-9d3d-142787531f60 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:14.814128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 49/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:14 2022] GET /identity/v3/role_assignments?user.id=c88fdfdb752649fdb268dae651ed0b98&scope.project.id=19c5b83802fe424184341375d3eccf4a&role.id=423552284f2a4983b5eef8fc699e5515 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:15.833053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb31b97-10b0-4129-af73-3578d00960b7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:15.834064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb31b97-10b0-4129-af73-3578d00960b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:15.834555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb31b97-10b0-4129-af73-3578d00960b7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:15.836467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 49/98] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:15.852430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:15.852934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:15.853016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:15.874284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:15.875480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:15.958299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:16.004616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb31b97-10b0-4129-af73-3578d00960b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:16.119186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb31b97-10b0-4129-af73-3578d00960b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:16.165280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fba7c-abdc-4ae5-940c-76b4ca315c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:16.166111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fba7c-abdc-4ae5-940c-76b4ca315c4d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.166401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fba7c-abdc-4ae5-940c-76b4ca315c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.166679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fba7c-abdc-4ae5-940c-76b4ca315c4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.169201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:16.184742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fba7c-abdc-4ae5-940c-76b4ca315c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-078fba7c-abdc-4ae5-940c-76b4ca315c4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:16.192629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:16.193482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:16.194223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 50/100] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:16.200013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:16.214309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81c2f4-704c-425d-96bf-2e922c1eedab None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.214597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81c2f4-704c-425d-96bf-2e922c1eedab None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.214883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81c2f4-704c-425d-96bf-2e922c1eedab None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.220111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 51/101] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:16.221516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.221802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.222080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.252342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:16.255572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:16.256795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:16.364611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af96f6-00fe-401f-9c6c-7c3b7552da4d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:16.405974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:16.406650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.406936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.407217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.407964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:16.408299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:16.409676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:16.417121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 52/102] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:16.423453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:16.428701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:16.457166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:16.596615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:16.607372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a69622-8df1-403a-915e-060cfecb7154 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:16.634655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6463f-d3a6-4713-860e-598d2a97ed68 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:16.665324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:16.672581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330dc5-c561-408b-96a9-4874acf85f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:16.673691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330dc5-c561-408b-96a9-4874acf85f44 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.674177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330dc5-c561-408b-96a9-4874acf85f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.674674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330dc5-c561-408b-96a9-4874acf85f44 None admin] PATH_INFO: `/v3/users/a58445693de241938705cca945eb6c98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.675381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edfe2e-5372-49e5-b5c5-adcde13ad0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:16.676176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfe2e-5372-49e5-b5c5-adcde13ad0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.676459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfe2e-5372-49e5-b5c5-adcde13ad0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.676734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edfe2e-5372-49e5-b5c5-adcde13ad0f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.689511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330dc5-c561-408b-96a9-4874acf85f44 None admin] RBAC: Authorizing `identity:get_user(user_id=a58445693de241938705cca945eb6c98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:16.691242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330dc5-c561-408b-96a9-4874acf85f44 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:16.692054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edfe2e-5372-49e5-b5c5-adcde13ad0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:16.693406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:16 2022] GET /identity/v3/users/a58445693de241938705cca945eb6c98 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:16.694822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e1ace-8d5f-42d9-a966-240bf015c204 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.695351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e1ace-8d5f-42d9-a966-240bf015c204 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.696390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e1ace-8d5f-42d9-a966-240bf015c204 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.698077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 54/105] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:16.699311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e1ace-8d5f-42d9-a966-240bf015c204 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-c2edfe2e-5372-49e5-b5c5-adcde13ad0f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:16.712943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:16.713861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:16.714621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:16.717014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 52/106] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:16.718493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.722133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.724198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.758765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:16.761261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:16.837223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e1ace-8d5f-42d9-a966-240bf015c204 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:16.876845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:16.877834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:16.878343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:16.878817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:16.901179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 53/107] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:16.902734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:16.973306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:16.998954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.000784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.106405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 55/108] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:17.107528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.124457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.162523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c2b4c-b4e3-49c4-9825-caf692378c28 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.206799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.207760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.208242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.208716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.209699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:17.210189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.211832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.222157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 54/109] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:17.223856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.284208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.308506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733150f-f858-4b79-bd6c-2552d758d4ec None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.349314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.350214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.350454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.350663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.351878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.353378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.355156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 56/110] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:17.355934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.365912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eaba99-c26d-4bca-a1f8-816f2b4457de None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.400939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cc5dc-5c73-4344-b585-d3a8892a7246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.401799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cc5dc-5c73-4344-b585-d3a8892a7246 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.402240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cc5dc-5c73-4344-b585-d3a8892a7246 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.402360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cc5dc-5c73-4344-b585-d3a8892a7246 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.403520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cc5dc-5c73-4344-b585-d3a8892a7246 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.404988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cc5dc-5c73-4344-b585-d3a8892a7246 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.410700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 55/111] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:17.410700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4ec5-644e-47bf-a889-3a39a7601546 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.410700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4ec5-644e-47bf-a889-3a39a7601546 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.410700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf4ec5-644e-47bf-a889-3a39a7601546 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.410700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 56/112] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:17.410700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d855-78db-4781-aa33-40625abf6a72 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.411102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d855-78db-4781-aa33-40625abf6a72 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.412088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316d855-78db-4781-aa33-40625abf6a72 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.412844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 57/113] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:17.413111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d855-78db-4781-aa33-40625abf6a72 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.425596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.470808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63056b46-26bf-41ce-9aa1-61b708699eab None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.505901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.506775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.507065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.507338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.508594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.510043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.511686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:17.516906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.519516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316d855-78db-4781-aa33-40625abf6a72 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.534804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.553071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367f017-2454-472b-8d1a-5eeaa0e7d832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.553722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f017-2454-472b-8d1a-5eeaa0e7d832 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.554007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f017-2454-472b-8d1a-5eeaa0e7d832 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.554282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367f017-2454-472b-8d1a-5eeaa0e7d832 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.555638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367f017-2454-472b-8d1a-5eeaa0e7d832 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.557117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367f017-2454-472b-8d1a-5eeaa0e7d832 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.581141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 58/115] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:45:17 2022] POST /identity/v3/projects => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:17.582569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e2431-4845-4f02-a854-5ae61a885176 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.582862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e2431-4845-4f02-a854-5ae61a885176 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.583141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e2431-4845-4f02-a854-5ae61a885176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.600980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fe9e2431-4845-4f02-a854-5ae61a885176 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:17.602829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fe9e2431-4845-4f02-a854-5ae61a885176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:17.635549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17bf5b-69fb-429b-8ff9-39cae00576ad None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.666123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.675855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.676645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.677001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.677380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.678237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] RBAC: Adding query filter params (role.id=38566b038de048beacd378c8d30e46db, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=a58445693de241938705cca945eb6c98) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:17.678617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.679353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 59/116] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:17.681078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.681374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.681654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.685241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548f9c-16ba-4b1f-a6fa-a6761d0f015c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.697784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 58/117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/role_assignments?user.id=a58445693de241938705cca945eb6c98&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=38566b038de048beacd378c8d30e46db => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:17.699232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:17.699784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c784-6243-42b9-b0c5-e94d5f56d811 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.700274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c784-6243-42b9-b0c5-e94d5f56d811 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.700479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:17.700992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c784-6243-42b9-b0c5-e94d5f56d811 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.702835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 59/118] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:17.703830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c784-6243-42b9-b0c5-e94d5f56d811 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.796744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 60/119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:17.797690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:17.832173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.858322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c784-6243-42b9-b0c5-e94d5f56d811 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.898331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194c15c-8901-4928-b6c6-a6b93a203e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.899729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c15c-8901-4928-b6c6-a6b93a203e89 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.900037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c15c-8901-4928-b6c6-a6b93a203e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.900321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194c15c-8901-4928-b6c6-a6b93a203e89 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.901525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194c15c-8901-4928-b6c6-a6b93a203e89 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:17.902977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194c15c-8901-4928-b6c6-a6b93a203e89 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:17.904742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 60/120] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:17.905906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.906191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.906468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.916876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d3667-650a-4960-bf68-5a2be9e77727 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:17.924773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:17.926016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:17.938571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:17.953842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:17.954920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:17.955278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:17.955734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:17.967859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:17.976692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:17.978133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:17.978898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:17.979507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.000298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 61/122] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:18.007994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.089478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a846b2-8696-4d1d-ba6f-0307424605b6 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.123005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.123862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.124221 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.124499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.125260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:18.137459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:18.146066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:18.146909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:18.147677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:18.151601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2afb4-d06f-4413-9d35-429a718cd823 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.152132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.197176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.198051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.198339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.198619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/c88fdfdb752649fdb268dae651ed0b98/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.201147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c907e05824b55afd1b5fdd114a1a5, user_id=c88fdfdb752649fdb268dae651ed0b98, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:18.203366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:18.220362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:18.221358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 62/124] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:18 2022] PUT /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/c88fdfdb752649fdb268dae651ed0b98/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:18.224923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.311483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45643f15-cb40-4969-9201-6c3a96c546b5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.386883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.387797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.388117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.388400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.389165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:18.389475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:18.390893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:18.408713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:18.409584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.412208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc140ca-7601-416f-b22a-be9514c030b8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.460502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.462288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.462588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.462932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.473258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:18.479203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:18.489741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:18.490817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:18.491641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:18.494747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:18.495750 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.554459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7be407-d3fe-489b-994f-ac06fee55e8e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.556554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:18.610720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.611770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.613307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.613800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.614931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:18.616344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:18.618212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:18.631779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:18.635619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918def7-3e8b-49d2-9302-b819380fff07 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.637361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.693946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.695797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.697757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.698237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.700316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:18.702049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:18.706725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 64/128] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:18.709388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.818346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf486f8c-093c-4719-a069-02d28f59aa01 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.825081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:18.865502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.866183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.866471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.866748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.867553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:18.867865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:18.869296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:18.884184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:18.885074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:18.897257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c7c32-0699-435b-b651-46c41927aa7f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:18.936414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:18.982019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:18.983286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:18.983762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:18.984265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:18.988692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:18.990370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:18.992309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 65/130] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:18.993392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:19.026190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193dd8b-21cd-480d-a718-802a162b1fdf None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.062029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.062894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.063181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.063464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.064672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.066436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.068607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:19.069326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:19.180296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:19.188639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107b385-3d1a-47d6-9856-887ad368acf3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.203349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f9540-6d52-47cd-9c63-eafc3c690c4e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.237760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.238640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.238925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.239580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.240595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.242058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.244484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:18 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:19.244971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:19.249292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:19.279089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.279951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.280256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.280532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] PATH_INFO: `/v3/projects/19c5b83802fe424184341375d3eccf4a` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.283695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=19c5b83802fe424184341375d3eccf4a)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.287193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.288927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 67/133] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:19 2022] GET /identity/v3/projects/19c5b83802fe424184341375d3eccf4a => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:19.289740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:19.378521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea865d-e874-4d47-8e7e-5e42291c041d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.421373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444f24b-f592-4605-9bca-4d00de8e8bd7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.437673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.438584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.438868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.439149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/80104af4696c44369cc93327cb4e59bd/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.441377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c907e05824b55afd1b5fdd114a1a5, user_id=80104af4696c44369cc93327cb4e59bd, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.442844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.457001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:19 2022] PUT /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/80104af4696c44369cc93327cb4e59bd/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:19.458464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:19.479930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.481217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.481652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.482103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.486145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.488032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.490249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 68/135] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:19 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:19.496821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:19.536404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:19.551638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:19.626017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a0543-cc1f-471b-99fc-28ee8d307f9c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.668089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe151e69-2a31-4df0-9d26-d1d7987d758d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:19.711133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb90f0f-ee5f-41c6-a9e6-35648fc0f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.712380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90f0f-ee5f-41c6-a9e6-35648fc0f616 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.712765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90f0f-ee5f-41c6-a9e6-35648fc0f616 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.713133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb90f0f-ee5f-41c6-a9e6-35648fc0f616 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/c88fdfdb752649fdb268dae651ed0b98/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.716032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90f0f-ee5f-41c6-a9e6-35648fc0f616 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c907e05824b55afd1b5fdd114a1a5, user_id=c88fdfdb752649fdb268dae651ed0b98, role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.717611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb90f0f-ee5f-41c6-a9e6-35648fc0f616 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.734291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8520f3-f3cd-44d1-ae6b-9dc0e5cf43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:19.743026 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 69/136] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:19 2022] PUT /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/c88fdfdb752649fdb268dae651ed0b98/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:19.743586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8520f3-f3cd-44d1-ae6b-9dc0e5cf43a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.743890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8520f3-f3cd-44d1-ae6b-9dc0e5cf43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.744243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8520f3-f3cd-44d1-ae6b-9dc0e5cf43a7 None admin] PATH_INFO: `/v3/projects/19c5b83802fe424184341375d3eccf4a/users/c88fdfdb752649fdb268dae651ed0b98/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.746525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8520f3-f3cd-44d1-ae6b-9dc0e5cf43a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=19c5b83802fe424184341375d3eccf4a, user_id=c88fdfdb752649fdb268dae651ed0b98, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:19.748215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8520f3-f3cd-44d1-ae6b-9dc0e5cf43a7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:19.768534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 68/137] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:19 2022] PUT /identity/v3/projects/19c5b83802fe424184341375d3eccf4a/users/c88fdfdb752649fdb268dae651ed0b98/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:19.962643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814f4b-d8a7-46e8-a3e5-a77b82e17dbf None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.963138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814f4b-d8a7-46e8-a3e5-a77b82e17dbf None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.963226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90814f4b-d8a7-46e8-a3e5-a77b82e17dbf None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.965119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 70/138] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:19.970752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4e5f-b783-4c95-8027-2085b54857e6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:19.971474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4e5f-b783-4c95-8027-2085b54857e6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:19.971546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4e5f-b783-4c95-8027-2085b54857e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:19.989352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-574b4e5f-b783-4c95-8027-2085b54857e6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:19.990589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-574b4e5f-b783-4c95-8027-2085b54857e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:20.066904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 69/139] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:20.090466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814f4b-d8a7-46e8-a3e5-a77b82e17dbf None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:20.200704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:20.214051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90814f4b-d8a7-46e8-a3e5-a77b82e17dbf None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:20.218736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae21bf-2735-408b-9aa1-2da103545b23 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:20.219030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae21bf-2735-408b-9aa1-2da103545b23 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:20.219308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae21bf-2735-408b-9aa1-2da103545b23 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:20.220961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 70/140] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:20.225608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:20.225891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:20.226170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:20.248961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:20.250381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:20.294812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:20.296340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:20.296629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:20.296909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:20.317095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:20.328937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:20.329796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:20.330544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 71/141] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:20.344174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:20.362843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:20.399847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:20.447402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:20.534190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb902ac-7da8-448e-b64c-b22bd4d9779b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:20.620519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6fadd-d8a4-4a5a-a4de-4dc8a935eb36 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:20.636699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:20.637398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:20.637686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:20.637965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:20.638731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:20.639044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:20.640479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:20.666420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 72/143] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:20.672334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:20.686854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:20.687681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:20.687966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:20.688271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:20.692728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:20.694343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:20.696759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 72/144] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:20.702145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:20.712320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:20.800848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:20.895309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e532ca-3b7b-4fc3-893f-f94da7def4c8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:20.961074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:20.961765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:20.962053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:20.962335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:20.963069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:20.964724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:20.971951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ab537-b24e-43bd-b0ce-39a46f0cdb9d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:21.005369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 73/145] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:20 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:45:21.066502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6141d2-e33c-4ef5-96b0-298b8aed874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:21.067321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6141d2-e33c-4ef5-96b0-298b8aed874b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.067606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6141d2-e33c-4ef5-96b0-298b8aed874b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.067887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6141d2-e33c-4ef5-96b0-298b8aed874b None admin] PATH_INFO: `/v3/users/a58445693de241938705cca945eb6c98` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.072829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6141d2-e33c-4ef5-96b0-298b8aed874b None admin] RBAC: Authorizing `identity:get_user(user_id=a58445693de241938705cca945eb6c98)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:21.074339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6141d2-e33c-4ef5-96b0-298b8aed874b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:21.076111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 73/146] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:20 2022] GET /identity/v3/users/a58445693de241938705cca945eb6c98 => generated 289 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:21.081817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:21.144415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0ba8-8a06-4dd2-9af9-261ebdc5ce8b None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.144768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0ba8-8a06-4dd2-9af9-261ebdc5ce8b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.144987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c0ba8-8a06-4dd2-9af9-261ebdc5ce8b None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.146396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 74/147] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:21.161661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.161973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.162227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.194875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:21.196691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:21.263539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5118b-a0e1-4f13-b0a4-88d6b0c7f890 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:21.280625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:21.337488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:21.338711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.340381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.340879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.342578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:21.344787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:21.346630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 75/148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:21.348832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 74/149] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:21 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:21.354674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:21.370393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:21.385124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:21.526758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc5af-7bff-4888-a458-4a3ca4080b9e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:21.566378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82047bd-debc-47ec-9992-f6bd9229bbfa None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:21.587190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:21.588229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.588456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.588731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/a58445693de241938705cca945eb6c98/roles/38566b038de048beacd378c8d30e46db` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.591794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c907e05824b55afd1b5fdd114a1a5, user_id=a58445693de241938705cca945eb6c98, role_id=38566b038de048beacd378c8d30e46db)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:21.593269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:21.615476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 76/150] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:21 2022] PUT /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/users/a58445693de241938705cca945eb6c98/roles/38566b038de048beacd378c8d30e46db => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:21.627168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:21.628006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.628298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.628577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.643749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:21.652671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:21.653618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:21.654401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 75/151] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:21.661470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:21.767305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:21.808672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113de4a6-6d78-430e-a190-60cce53f1b9f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:21.850810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:21.851405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:21.851753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:21.852550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:21.853306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:21.853611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:21.855101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:21.865645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 77/152] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:21.871717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:21.911056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:21.987044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed5b3-a167-4934-bc91-e4a98e7c685f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:22.025774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:22.026656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:22.026941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:22.027220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:22.028517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:22.029993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:22.031832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 76/153] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:21 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:22.037387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:22.175781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243012d1-ce38-47f4-9d68-ec51fd745eb5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:22.215289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:22.220584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:22.221803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:22.222462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:22.222744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:22.305910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:22.307395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:22.424370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 78/154] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:22.430061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:22.544226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56f951-dd3b-4e56-8073-836d880d3638 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:22.548645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:22.583243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c842b4c-4474-4ca2-8a28-0c77964dfc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:22.584147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842b4c-4474-4ca2-8a28-0c77964dfc81 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:22.584435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842b4c-4474-4ca2-8a28-0c77964dfc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:22.584715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842b4c-4474-4ca2-8a28-0c77964dfc81 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:22.585946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c842b4c-4474-4ca2-8a28-0c77964dfc81 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:22.587922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c842b4c-4474-4ca2-8a28-0c77964dfc81 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:22.589857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 77/155] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:22 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:22.595752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:22.628345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:22.647099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7894-95a6-4c34-91ac-4ddeb38028fb None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:22.647409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7894-95a6-4c34-91ac-4ddeb38028fb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:22.647662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7894-95a6-4c34-91ac-4ddeb38028fb None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:22.649826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 78/156] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:22.659122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:22.659407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:22.659688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:22.681202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:22.682347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:22.752897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04516398-deb0-46a8-953e-9f248d480e5c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:22.821418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 79/157] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:22.825414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:22.826078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:22.826417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:22.826706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:22.827608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=c88fdfdb752649fdb268dae651ed0b98) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:22.827932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:22.829412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:22.835696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 79/158] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:22 2022] GET /identity/v3/role_assignments?user.id=c88fdfdb752649fdb268dae651ed0b98&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=423552284f2a4983b5eef8fc699e5515 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:22.857229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:22.988516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff99a9-1397-4e62-a78a-4829ef7553ce None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:22.990306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:23.041737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afbda7-c492-484b-ae83-f169cbae6c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:23.042694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afbda7-c492-484b-ae83-f169cbae6c7c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.042982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afbda7-c492-484b-ae83-f169cbae6c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.043263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afbda7-c492-484b-ae83-f169cbae6c7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.054594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afbda7-c492-484b-ae83-f169cbae6c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-96afbda7-c492-484b-ae83-f169cbae6c7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:23.067586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:23.068655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:23.069408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 80/159] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:23.076083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:23.166396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db88c8-7706-4eec-bab0-4b7b8e02f00b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.166697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db88c8-7706-4eec-bab0-4b7b8e02f00b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.166960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db88c8-7706-4eec-bab0-4b7b8e02f00b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.168537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 81/160] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:23.174030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.174320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.174721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.192158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:23.193553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:23.210905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:23.219412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bfb2b-3099-4be8-a66e-38e40c1070b3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:23.276155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:23.276755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.277036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.277315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.278072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:23.278380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:23.279760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcc854-8374-4092-b5e5-5645bf2d1d79 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:23.285859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 82/161] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:23.297343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 80/162] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:23.302577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:23.316337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa69f-c655-416d-849f-f487104f239c None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.316614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa69f-c655-416d-849f-f487104f239c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.316896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aa69f-c655-416d-849f-f487104f239c None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.318400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 81/163] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:23.323405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395df59-55c6-4f78-9684-81528c684256 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.323710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395df59-55c6-4f78-9684-81528c684256 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.323982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395df59-55c6-4f78-9684-81528c684256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.354185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a395df59-55c6-4f78-9684-81528c684256 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:23.355403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a395df59-55c6-4f78-9684-81528c684256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:23.500935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:23.506456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 82/164] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:23.507113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395df59-55c6-4f78-9684-81528c684256 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:23.509852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566abc5-13bf-4287-ab4f-808afbc218cd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:23.588776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:23.589590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.589872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.590147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] PATH_INFO: `/v3/users/80104af4696c44369cc93327cb4e59bd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.591408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=80104af4696c44369cc93327cb4e59bd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:23.592882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:23.594852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 83/165] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:23 2022] GET /identity/v3/users/80104af4696c44369cc93327cb4e59bd => generated 247 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:23.595455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:23.633915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:23.647810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395df59-55c6-4f78-9684-81528c684256 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:23.688180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:23.689086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.689371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.689650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.706788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:23.715625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:23.716543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:23.717299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 83/166] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:23.718178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:23.823698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c71624-d798-4598-87e3-16aec0aa2f30 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:23.849951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50328-6cda-433f-b68a-7b4ff3715dc2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:23.876174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:23.877137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.877430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.877712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.906008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:23.934008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:23.934811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:23.935088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:23.935358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:23.952889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:23.960631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:23.961543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:23.962318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 84/167] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:23.963023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:23.984842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:23.991792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:23.994183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.142353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db99be-d253-45ef-9aa8-e3c1847b59c5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.212832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.213927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.214456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.214966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.215915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:24.216464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:24.218042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.225873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 84/168] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:24.227396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.237186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 85/169] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:24.238340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.312014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:24.374624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f36c7-0a0a-423c-ab95-4446a6aa5704 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.408651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.409248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.409539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.409817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.410572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:24.410883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:24.412328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.421416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 85/170] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:24.422154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.450190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:24.498734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d047254-a9af-41fe-98a7-a27b6b1fd6a4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.547459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.548383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.548669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.548947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.550155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:24.551613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.553754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 86/171] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:24.554362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.560218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec72f3-8686-41c0-af35-5b34ccfc16a0 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.580337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:24.624846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.625760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.626048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.626327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.627714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:24.629204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.631019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 86/172] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:24.632476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.668341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff517c-b3a6-4a31-8db1-2a0c0f7a7c0a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.704257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.705146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.705434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.705710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] PATH_INFO: `/v3/users/c88fdfdb752649fdb268dae651ed0b98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.706920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] RBAC: Authorizing `identity:get_user(user_id=c88fdfdb752649fdb268dae651ed0b98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:24.708407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.710222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 87/173] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/users/c88fdfdb752649fdb268dae651ed0b98 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:24.710824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.737693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:24.779287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa4c7-5ffc-4fd9-b419-bbc7be1966dd None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.813468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.814123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.814409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.814688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.815521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=80104af4696c44369cc93327cb4e59bd) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:24.815834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:24.817310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:24.823795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 87/174] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/role_assignments?user.id=80104af4696c44369cc93327cb4e59bd&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:24.824636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:24.871706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:24.902523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910a6a-97c6-4c75-9bce-e0f61e2a0283 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.933355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cf252-1d97-4174-b5ef-62da5107f69f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:24.964715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.965395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.965677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.965952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:24.969120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:24.969857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:24.970212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:24.970553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.044106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:25.045747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:25.067678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:25.069264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:25.104506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:25.112482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:25.176497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 88/175] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:25.181684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:25.224826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 88/176] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:25.230735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:25.326500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04395082-1eaa-43f4-8680-022b9277072d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:25.384745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:25.385667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.385910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.386189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] PATH_INFO: `/v3/projects/19c5b83802fe424184341375d3eccf4a` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.387481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] RBAC: Authorizing `identity:get_project(project_id=19c5b83802fe424184341375d3eccf4a)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:25.388974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:25.391053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 89/177] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:25 2022] GET /identity/v3/projects/19c5b83802fe424184341375d3eccf4a => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:25.396573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:25.402034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be658545-56af-4466-8d03-fbdf22f6dcb3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:25.411992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:25.437581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:25.469512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:25.470580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.470873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.471149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.473590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:25.475236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:25.477403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 89/178] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:25 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:25.482815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:25.519659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1516b-e592-4fe7-b6db-8c663a39ccb3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:25.581432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:25.582083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.582360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.582634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.583465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=19c5b83802fe424184341375d3eccf4a, user.id=c88fdfdb752649fdb268dae651ed0b98) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:25.583773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:25.585246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df57e98-c9e2-465a-84b1-05b1141a15b0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:25.592003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 90/179] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:25 2022] GET /identity/v3/role_assignments?user.id=c88fdfdb752649fdb268dae651ed0b98&scope.project.id=19c5b83802fe424184341375d3eccf4a&role.id=423552284f2a4983b5eef8fc699e5515 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:25.592805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d27a8-7613-45b4-a969-8954a6fc7235 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.593137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d27a8-7613-45b4-a969-8954a6fc7235 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.593408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d27a8-7613-45b4-a969-8954a6fc7235 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.594642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 91/180] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:25.595712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7b74-03b8-4320-bf66-8822f12f34c9 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.596011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7b74-03b8-4320-bf66-8822f12f34c9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.600632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf7b74-03b8-4320-bf66-8822f12f34c9 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.602188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 92/181] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:25.608016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.608303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.608581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.627298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:25.628879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:25.634386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabe7f2-ca95-4e74-b996-d438cebe4fc9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:25.672177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:25.673221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.673725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.674204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.675250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] RBAC: Adding query filter params (role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=c88fdfdb752649fdb268dae651ed0b98) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:25.675772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:25.677465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7b4d8-30fb-46c7-a912-6054638d1924 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:25.684866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 90/182] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:25 2022] GET /identity/v3/role_assignments?user.id=c88fdfdb752649fdb268dae651ed0b98&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:25.686473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8959a-1b9c-4a16-a172-e5479f3e1477 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.687015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8959a-1b9c-4a16-a172-e5479f3e1477 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.687494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8959a-1b9c-4a16-a172-e5479f3e1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.706009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-46c8959a-1b9c-4a16-a172-e5479f3e1477 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:25.707603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-46c8959a-1b9c-4a16-a172-e5479f3e1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:25.786727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:25.799996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 93/183] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:25.831713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 91/184] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:25.847423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:25.853367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:25.861441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247ca2-124f-43d9-8797-3a7d9210deae None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.861756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247ca2-124f-43d9-8797-3a7d9210deae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.862007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247ca2-124f-43d9-8797-3a7d9210deae None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.863647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 92/185] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:25.870393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:25.870868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:25.871166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:25.903622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:25.905029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:26.021762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 93/186] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:26.022652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.024298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1862d-7402-4a05-9a2d-0a17a9bafb9e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.061294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da701821-826b-4bca-8385-9d7c4a9bc556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.062141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701821-826b-4bca-8385-9d7c4a9bc556 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.062483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701821-826b-4bca-8385-9d7c4a9bc556 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.062927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da701821-826b-4bca-8385-9d7c4a9bc556 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.073054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da701821-826b-4bca-8385-9d7c4a9bc556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-da701821-826b-4bca-8385-9d7c4a9bc556 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:26.080594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:26.081654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:26.082481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 94/187] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:26.083127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f7348-9eb0-4740-aae5-cdf40d0347ce None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.083325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f7348-9eb0-4740-aae5-cdf40d0347ce None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.083803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f7348-9eb0-4740-aae5-cdf40d0347ce None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.089226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 95/188] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:26.089226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f7348-9eb0-4740-aae5-cdf40d0347ce None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.134168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c7476-35d7-41e8-b916-240829885c3e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.144590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.150711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.170038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.170837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.171125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.171406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.181596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:26.189386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:26.190274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:26.195868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:26.196518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f7348-9eb0-4740-aae5-cdf40d0347ce None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.196590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 94/189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:26.196590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.223538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b136a-2248-4fe6-864d-63d6a1139740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.224370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b136a-2248-4fe6-864d-63d6a1139740 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.224657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b136a-2248-4fe6-864d-63d6a1139740 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.224927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b136a-2248-4fe6-864d-63d6a1139740 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.236079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b136a-2248-4fe6-864d-63d6a1139740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-af3b136a-2248-4fe6-864d-63d6a1139740 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:26.244203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:26.245087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:26.245870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 96/190] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:26.246504 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.247021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.247112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.262916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:26.264120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:26.295594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c625ffa-56de-416c-af20-546f721b6d95 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.327917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.328547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.328828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.329100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.329226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 97/191] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:26.330129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.337208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:26.337613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.339075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.347888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 95/192] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.348571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.379244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.392637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.436128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6c010-efdd-41c0-8009-168c389552df None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.448834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf6ea0-e52a-44b6-b849-296782a13d06 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.469934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.470599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.470883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.471161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.472210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:26.472520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.473893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.481851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 98/193] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.482630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.484690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.485350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.485632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.485909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.486656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:26.486960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.488348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.500639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 96/194] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.500639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.584376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08a4bc-8844-4f06-a694-a52529c35355 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.585317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.593802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594edc2b-feeb-4c85-b1c1-9eff18c6cdb8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.600731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.620020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.620758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.621044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.621320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] PATH_INFO: `/v3/users/dd134f4f992c49a1890ba612446f760b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.627233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.628050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.628337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.628611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.629776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.631217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.633371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 97/195] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.634126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.635530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] RBAC: Authorizing `identity:get_user(user_id=dd134f4f992c49a1890ba612446f760b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.636999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.638791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 99/196] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/users/dd134f4f992c49a1890ba612446f760b => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.639442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.730562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb10f9-8ca0-481e-9290-e48422d3463a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.734639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1730e-8b63-4f15-bf35-2de25c59d425 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.762403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.763261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.763542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.763819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] PATH_INFO: `/v3/users/a58445693de241938705cca945eb6c98` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.765104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] RBAC: Authorizing `identity:get_user(user_id=a58445693de241938705cca945eb6c98)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.766537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.767280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.768181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.772647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 98/197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/users/a58445693de241938705cca945eb6c98 => generated 289 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.772736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.772736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] PATH_INFO: `/v3/users/dd134f4f992c49a1890ba612446f760b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.772859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.773966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] RBAC: Authorizing `identity:get_user(user_id=dd134f4f992c49a1890ba612446f760b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.775398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.777048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 100/198] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/users/dd134f4f992c49a1890ba612446f760b => generated 283 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:26.777792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.803092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.819608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:26.870875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1dc28-ea23-4f81-8df1-3ff00828c585 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.875124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f9ed7-80a2-4d4c-8937-cf6ae3a6f654 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:26.902780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.903442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.903721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.904020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.904728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.906163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:26.907698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:26.908362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:26.908650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:26.908931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:26.925280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 99/199] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:26 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:26.926382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:26.992689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:26.994320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.041024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.043014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.061737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056f6b1-cba9-4f22-882f-a969e0ab70cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.104400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.105056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.105342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.105712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.114475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 101/200] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:27.115330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.193622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.195200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.243319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e36ec-fd66-4af5-b3b4-69824a6f2d24 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.290268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.290923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.291202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.291777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.298191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.306227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.317878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 100/201] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:27.318846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.378429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.379929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.429304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b29a31-e38e-43dc-91a4-7bf4088b84ab None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.467919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.468778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.469061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.469340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.470659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.472578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.474508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 101/202] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:27.475278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.481401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 102/203] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:27.482277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.526960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.548095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.587728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e46ef-1652-4731-8072-6c1cc5814bab None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.615364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3499be7-1bc3-4352-a1f5-2aea7f3bc2ac None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.623074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.623727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.624042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.624321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.625157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=dd134f4f992c49a1890ba612446f760b) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:27.625465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.626904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.632727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 103/204] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/role_assignments?user.id=dd134f4f992c49a1890ba612446f760b&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:27.633586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.662441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.664582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.665397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.665867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.668577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.670549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.673584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 102/205] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:27.686322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.813913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6397e2d-a88f-40a3-ae8c-0e2de9af6e9a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.822540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.856072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.857071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.857430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.857737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.859037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.860746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.862455 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 104/206] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:27.863832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90059-4108-4274-b0db-885c216a83e8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:27.868561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:27.900085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:27.929574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:27.930850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:27.931118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:27.931392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:27.932283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] RBAC: Adding query filter params (role.id=38566b038de048beacd378c8d30e46db, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5, user.id=a58445693de241938705cca945eb6c98) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:27.932595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:27.934028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987e9c7-7527-4516-bcb3-f27b62305a5c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:27.946579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 103/207] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/role_assignments?user.id=a58445693de241938705cca945eb6c98&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=38566b038de048beacd378c8d30e46db => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:27.981920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed591315-235e-4133-8c5d-007b99cfd80c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:28.018301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:28.018954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:28.019234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:28.019506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:28.020373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] RBAC: Adding query filter params (role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=dd134f4f992c49a1890ba612446f760b) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:28.020693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:28.022124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e874e4-478d-492d-a140-d0b72055405a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:28.028476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 105/208] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:27 2022] GET /identity/v3/role_assignments?user.id=dd134f4f992c49a1890ba612446f760b&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:29.254877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1cff-4c37-40f7-8a09-08dd74b80c71 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.255874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1cff-4c37-40f7-8a09-08dd74b80c71 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.256424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1cff-4c37-40f7-8a09-08dd74b80c71 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.258826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 104/209] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:29.264439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.265248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.265731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.283124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:29.284698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:29.288311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79eccb-63a6-4785-81e7-480036a427e4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.288816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79eccb-63a6-4785-81e7-480036a427e4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.289334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79eccb-63a6-4785-81e7-480036a427e4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.290850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 105/210] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:29.296061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.296570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.297038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.317139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:29.318633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:29.328661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:29.390250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 106/211] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:29.391107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 106/212] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:29.414612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:29.417378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:29.515867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49796979-e25b-4e04-9413-a32dcf3af2a3 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:29.531372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20aaef-4b8c-4c6f-9c4b-47d0d951df91 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:29.549932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:29.551209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:29.552269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.552564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.552845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.563360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:29.569803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:29.571138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.571415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.571689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:29.572550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:29.573398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:29.574167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:29.574757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:29.574831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 107/213] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:29.574897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:29.579488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:29.580639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:29.581458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:29.609739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:29.683518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81ac0-7ae9-4d54-8b88-d079ed5e9bda None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:29.693030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec390b63-511b-458e-b892-0643367e8f02 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:29.718821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:29.719496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.719784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.720103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.720864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:29.721176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:29.722845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:29.731088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0f329-435a-4759-bfdb-581eab9d4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:29.731757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f329-435a-4759-bfdb-581eab9d4d0c None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.732060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f329-435a-4759-bfdb-581eab9d4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.732335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0f329-435a-4759-bfdb-581eab9d4d0c None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.733057 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0f329-435a-4759-bfdb-581eab9d4d0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:29.734495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0f329-435a-4759-bfdb-581eab9d4d0c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:29.736138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 108/215] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:29.740924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:29.758009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 108/216] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:29 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:29.834603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb59d0-517d-4ff3-bc79-d2509274c087 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.834914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb59d0-517d-4ff3-bc79-d2509274c087 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.835159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb59d0-517d-4ff3-bc79-d2509274c087 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.837176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 109/217] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:29.842989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.843457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.843745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.846116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:29.857561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ad679-2756-45ca-a14b-709011c061f4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:29.865629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:29.866923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:29.894006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:29.894909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:29.895197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:29.895477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] PATH_INFO: `/v3/users/8d6edd1d2d834152b3a34ce3ca83cb33` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:29.907589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:29.911258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] RBAC: Authorizing `identity:get_user(user_id=8d6edd1d2d834152b3a34ce3ca83cb33)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:29.912973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:29.915604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 109/218] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:29 2022] GET /identity/v3/users/8d6edd1d2d834152b3a34ce3ca83cb33 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:29.921437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:29.951181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 110/219] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:29.974844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.036883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d64503-a1a1-40ae-8f06-d543c45dbcab None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.080145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e00a7-85f2-4a41-b90a-31b4f5057807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.081292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e00a7-85f2-4a41-b90a-31b4f5057807 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.081823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e00a7-85f2-4a41-b90a-31b4f5057807 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.082297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e00a7-85f2-4a41-b90a-31b4f5057807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.102993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.103116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461f7fa-9cde-47bc-9201-da5f17c8fa11 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.150154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.150960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.151250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.151530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.164573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:30.167133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e00a7-85f2-4a41-b90a-31b4f5057807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:30.168641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e00a7-85f2-4a41-b90a-31b4f5057807 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:30.173800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:30.174723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:30.175511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 111/220] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:30.182594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.228642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.290278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 110/221] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:30.291614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e1044-f7ea-4120-82a9-a9451725dac0 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.291897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e1044-f7ea-4120-82a9-a9451725dac0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.292197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e1044-f7ea-4120-82a9-a9451725dac0 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.293718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 111/222] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:30.298460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e1044-f7ea-4120-82a9-a9451725dac0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.330280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484b507-a104-4428-b34d-19287e863d52 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.368884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.371361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.372075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.372366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.372644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.373916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:30.374235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:30.375950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c1dc5-24cb-4a6a-a1b2-2566830e45c3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:30.392012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 112/223] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:30.393676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.393975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.394249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.418867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:30.420359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:30.438495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e1044-f7ea-4120-82a9-a9451725dac0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.486556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.488375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.488841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.489311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.490795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:30.491619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 113/224] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:30.493085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:30.496314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 112/225] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:30.501021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.502072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.545734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.614182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d263d74-4447-41e7-9e8e-9efc3ace65a7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.633083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.647793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341c48e-5a60-41bd-8ed6-467e8e3f7774 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.654206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.655135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.655634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.656137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.657289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=8d6edd1d2d834152b3a34ce3ca83cb33) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:30.657802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:30.659619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:30.666348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 113/226] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/role_assignments?user.id=8d6edd1d2d834152b3a34ce3ca83cb33&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=423552284f2a4983b5eef8fc699e5515 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:30.667339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.708898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.710198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.712734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.713295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] PATH_INFO: `/v3/users/dd134f4f992c49a1890ba612446f760b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.714931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] RBAC: Authorizing `identity:get_user(user_id=dd134f4f992c49a1890ba612446f760b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:30.717558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:30.720420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 114/227] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/users/dd134f4f992c49a1890ba612446f760b => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:30.728440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.840263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05745fe7-019a-402f-a4bc-ca01a6bea30f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.882411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.884223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.884711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.885185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.906219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:30.916639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:30.917538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:30.918342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 114/228] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:30.919932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.924912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:30.936076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd473144-a6a5-4088-b8b3-1935e008629f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:30.972343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:30.973581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:30.974114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:30.974603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:30.976088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:30.976431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:30.978927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:30.981338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 115/229] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:30.987231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:31.044236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1fa9-c675-408b-8505-9307ab1a1b5a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:31.082764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:31.083560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:31.083849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:31.084153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:31.084907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:31.085218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:31.086811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:31.096828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 115/230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:31.103000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:31.180558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db7bc-1448-4ffd-8b30-c6931cad1b94 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:31.212312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15495-409f-4f65-b6d0-b73677190818 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:31.213821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:31.248260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:31.249141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:31.249422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:31.249702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] PATH_INFO: `/v3/users/dd134f4f992c49a1890ba612446f760b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:31.250891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] RBAC: Authorizing `identity:get_user(user_id=dd134f4f992c49a1890ba612446f760b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:31.252365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:31.254075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:31.254201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 116/231] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:31 2022] GET /identity/v3/users/dd134f4f992c49a1890ba612446f760b => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:31.254990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:31.255271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:31.255546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692/users/dd134f4f992c49a1890ba612446f760b/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:31.260316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:31.264846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=279158339e1e4648ac9028e333ebd692, user_id=dd134f4f992c49a1890ba612446f760b, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:31.266434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:31.290774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 116/232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:30 2022] PUT /identity/v3/projects/279158339e1e4648ac9028e333ebd692/users/dd134f4f992c49a1890ba612446f760b/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:31.369878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7389-3fbe-4fe8-ba8f-85cc05ed5236 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:31.407191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c73b2-7047-4bbb-bd7e-57ef9135687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:31.408095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c73b2-7047-4bbb-bd7e-57ef9135687c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:31.408374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c73b2-7047-4bbb-bd7e-57ef9135687c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:31.408646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c73b2-7047-4bbb-bd7e-57ef9135687c None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:31.409835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c73b2-7047-4bbb-bd7e-57ef9135687c None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:31.411301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c73b2-7047-4bbb-bd7e-57ef9135687c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:31.413332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 117/233] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:31 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:31.419014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:31.447864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:31.540274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77b60b-14c0-4feb-a284-bead65dd81e7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:31.579075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275412a-cee2-4e35-b2dd-1fa96dc3004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:31.579969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275412a-cee2-4e35-b2dd-1fa96dc3004b None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:31.580284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275412a-cee2-4e35-b2dd-1fa96dc3004b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:31.580559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275412a-cee2-4e35-b2dd-1fa96dc3004b None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692/users/dd134f4f992c49a1890ba612446f760b/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:31.582772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275412a-cee2-4e35-b2dd-1fa96dc3004b None admin] RBAC: Authorizing `identity:create_grant(project_id=279158339e1e4648ac9028e333ebd692, user_id=dd134f4f992c49a1890ba612446f760b, role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:31.584229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275412a-cee2-4e35-b2dd-1fa96dc3004b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:31.601817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 117/234] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:31 2022] PUT /identity/v3/projects/279158339e1e4648ac9028e333ebd692/users/dd134f4f992c49a1890ba612446f760b/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:32.218075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfae4a-b0e6-4e1f-bf77-31c8c1dfdbb4 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.218436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfae4a-b0e6-4e1f-bf77-31c8c1dfdbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.218638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfae4a-b0e6-4e1f-bf77-31c8c1dfdbb4 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.220297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 118/235] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:32.225658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.225943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.226220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.249025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:32.250234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:32.337053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 118/236] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:32.368423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780394c3-3735-41af-9c47-f3d1324f3c3e None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.368696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780394c3-3735-41af-9c47-f3d1324f3c3e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.368892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780394c3-3735-41af-9c47-f3d1324f3c3e None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.370631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:32.370816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 119/237] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:32.386384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:32.387746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.387862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.388124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.416250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:32.417429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:32.483425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3a2a8-ed84-4489-a5df-9a08d4acec1a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:32.488976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:32.521983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:32.523176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.524226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.524703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.535592 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:32.549871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:32.550726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:32.551514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:32.553503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 119/238] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:32.564890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:32.574735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:32.602011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:32.701202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:32.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3ccc-6bd7-4bea-a03a-ee571187a300 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:32.775740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c6ed-a738-4bce-8c65-dcd974ab6a6b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:32.790208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:32.791277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.791785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.792283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.794322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:32.796415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:32.798881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 121/240] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:32.805666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:32.852673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:32.860068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:32.860869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:32.861153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:32.861434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:32.865276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:32.865276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:32.865276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:32.879406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 120/241] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:32.885714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:32.965512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeddf0f-9230-42c2-b100-bda5907bfbbd None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:33.017182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:33.017854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.018134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.018404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.019106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:33.020578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:33.059514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 122/242] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:32 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:33.061541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeebdf2-3a2e-452b-8b05-88f6941499e9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:33.104205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:33.116841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea452c8-5da3-43e7-9bfd-e2605aae50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:33.118291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea452c8-5da3-43e7-9bfd-e2605aae50e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.118571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea452c8-5da3-43e7-9bfd-e2605aae50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.118846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea452c8-5da3-43e7-9bfd-e2605aae50e6 None admin] PATH_INFO: `/v3/users/b3e64d244a364ae4a026f11f392f86d0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.142005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea452c8-5da3-43e7-9bfd-e2605aae50e6 None admin] RBAC: Authorizing `identity:get_user(user_id=b3e64d244a364ae4a026f11f392f86d0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:33.143966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea452c8-5da3-43e7-9bfd-e2605aae50e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:33.146370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 121/243] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:32 2022] GET /identity/v3/users/b3e64d244a364ae4a026f11f392f86d0 => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:33.152113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:33.295741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:33.307671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2591d21-e27e-4170-8c59-7d3df8b1b38e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:33.316367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688b019-672f-4e48-b0f2-41880a67c397 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.316659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688b019-672f-4e48-b0f2-41880a67c397 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.316944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688b019-672f-4e48-b0f2-41880a67c397 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.319680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 122/244] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:33.323854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.324427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.324925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.344261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:33.345806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:33.349100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:33.349761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.350042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.350319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.433228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 123/245] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:33.452838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:33.454949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:33.458355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:33.580688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:33.591956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 123/246] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:33.598117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:33.614047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8a9a-c033-4cdc-a34c-346266d3ce0f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:33.639289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:33.665109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:33.665916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.666201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.666480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.680936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:33.691551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:33.692578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:33.693374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 124/247] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:33.699751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:33.743018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6c0df-12e1-47fe-b4fb-5ad6ab01c91a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:33.798617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:33.800153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.800610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.801223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.805501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:33.807319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:33.810115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 124/248] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:33 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:33.819746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:33.889746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb9229-cd90-4843-96f7-047c955a2fd8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:33.945056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:33.962415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:33.963104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:33.963389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:33.963673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:33.964466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:33.964779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:33.966165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:33.987477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 125/249] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:33.992904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.030967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9d567-de9b-4525-bf5b-61eff6a624fb None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.068427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.069462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.069961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.071002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.072046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] RBAC: Adding query filter params (role.id=38566b038de048beacd378c8d30e46db, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=b3e64d244a364ae4a026f11f392f86d0) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:34.072552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.074358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511ba9a-9898-4efa-986d-a301193af202 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.080913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 125/250] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:33 2022] GET /identity/v3/role_assignments?user.id=b3e64d244a364ae4a026f11f392f86d0&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=38566b038de048beacd378c8d30e46db => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:34.082475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9d455-6ad2-4734-84a8-c99e8893ad62 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.082972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9d455-6ad2-4734-84a8-c99e8893ad62 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.083448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9d455-6ad2-4734-84a8-c99e8893ad62 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.085019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 126/251] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:34.088873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:34.095052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.095964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.096937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.116326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:34.117988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:34.196611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 127/252] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:34.222234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.260633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6cee8-1c66-4af8-95d1-88b5b0e71c98 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.284288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:34.333607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a8eb5-ce76-4ce5-a303-1096bc160dd9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.349590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.350488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.350812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.351042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] PATH_INFO: `/v3/users/8d6edd1d2d834152b3a34ce3ca83cb33` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.352331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] RBAC: Authorizing `identity:get_user(user_id=8d6edd1d2d834152b3a34ce3ca83cb33)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.353929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.355608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 126/253] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:33 2022] GET /identity/v3/users/8d6edd1d2d834152b3a34ce3ca83cb33 => generated 297 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:34.361022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.372413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.373490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.373985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.374457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.386103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:34.394252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:34.395131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:34.395895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:34.398652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 128/254] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:34.404393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.510140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc38c2-615b-40c6-a8d9-c07056ea33e4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.525415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:34.548228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.549216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.549719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.550181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.551116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:34.551637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.553229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.562741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 129/255] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:34.568378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.626188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f2e6c-3038-46a2-9e9a-aa65ce22709c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.646472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:34.675099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822c100-8b1a-4897-ab89-89981d3dc805 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.710344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.711249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.711531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.711803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] PATH_INFO: `/v3/users/dd134f4f992c49a1890ba612446f760b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.713076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] RBAC: Authorizing `identity:get_user(user_id=dd134f4f992c49a1890ba612446f760b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.713546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.714422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.714521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.714707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.714985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.716300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 130/256] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:34 2022] GET /identity/v3/users/dd134f4f992c49a1890ba612446f760b => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:34.716408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.717640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.719454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 127/257] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:34 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:34.721670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.724877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:34.771908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:34.829473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b507f4-f562-48d7-a84d-fd0835aeb9fc None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.863831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.865088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.865088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.865088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.897527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5cf29-7b95-4233-bd88-8de05f93b370 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:34.935559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.939998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.942758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5668-0461-4ee6-88eb-50ed26edbb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:34.943964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5668-0461-4ee6-88eb-50ed26edbb93 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.944478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5668-0461-4ee6-88eb-50ed26edbb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.945094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5668-0461-4ee6-88eb-50ed26edbb93 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692/users/8d6edd1d2d834152b3a34ce3ca83cb33/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.952864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5668-0461-4ee6-88eb-50ed26edbb93 None admin] RBAC: Authorizing `identity:create_grant(project_id=279158339e1e4648ac9028e333ebd692, user_id=8d6edd1d2d834152b3a34ce3ca83cb33, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:34.954631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5668-0461-4ee6-88eb-50ed26edbb93 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:34.974816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 128/258] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:34 2022] PUT /identity/v3/projects/279158339e1e4648ac9028e333ebd692/users/8d6edd1d2d834152b3a34ce3ca83cb33/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:34.976478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665192b2-1339-4f8f-8907-d81a1b79e59a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.976971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665192b2-1339-4f8f-8907-d81a1b79e59a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.977444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665192b2-1339-4f8f-8907-d81a1b79e59a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:34.979480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 129/259] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:34.985319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:34.985988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:34.986471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:34.987782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:35.021505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:35.023278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:35.050353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 131/260] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:45:35.055957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:35.073671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:35.145441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 130/261] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:35.169155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afac5-4fea-4565-88a5-aae1aa579d32 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:35.189563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:35.204846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:35.207107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:35.207489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:35.207862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:35.209350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:35.211513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:35.213607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 132/262] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:35 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:35.219385 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:35.239859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:35.327214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe30e1d-5d1a-4dcd-8571-c9bb11388760 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:35.381601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:35.382430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:35.383536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:35.383536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:35.409343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:35.418741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6781ab2-5a2c-4750-bf50-d81ad558d2ec None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:35.428232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:35.429143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:35.430184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 131/263] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:35.436596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:35.473643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:35.474672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:35.475104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:35.475533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:35.476569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=dd134f4f992c49a1890ba612446f760b) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:35.477024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:35.478605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:35.489954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:35.494840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 133/264] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:35 2022] GET /identity/v3/role_assignments?user.id=dd134f4f992c49a1890ba612446f760b&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:35.569147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4700e-e750-483e-a5d1-1fa31724c75e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:35.607192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:35.607787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:35.608089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:35.608370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:35.609245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:35.609555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:35.610949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:35.623964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 132/265] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:35.629715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:35.748832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:35.780386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856283c-fc44-4a8a-b0a9-b55509a22156 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:35.823605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:35.824851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:35.825356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:35.825846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] PATH_INFO: `/v3/users/dd134f4f992c49a1890ba612446f760b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:35.827244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] RBAC: Authorizing `identity:get_user(user_id=dd134f4f992c49a1890ba612446f760b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:35.828933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:35.835302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 134/266] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:35 2022] GET /identity/v3/users/dd134f4f992c49a1890ba612446f760b => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:35.837058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:35.955085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:35.972612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37a109-d946-451d-9ecf-01788ed1f581 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:36.022037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc12ad6c-9a88-4f48-b29c-92f90cc8965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:36.023062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12ad6c-9a88-4f48-b29c-92f90cc8965b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.023610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12ad6c-9a88-4f48-b29c-92f90cc8965b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.024121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12ad6c-9a88-4f48-b29c-92f90cc8965b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.119960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12ad6c-9a88-4f48-b29c-92f90cc8965b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:36.121484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc12ad6c-9a88-4f48-b29c-92f90cc8965b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:36.211214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:36.226178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 133/267] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:36.231961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:36.354581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03545182-bc39-40f9-8334-479af165bcf5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:36.373491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8b9c-b731-4d08-a618-462bc6a20b1e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.373782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8b9c-b731-4d08-a618-462bc6a20b1e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.374049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8b9c-b731-4d08-a618-462bc6a20b1e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.375593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 134/268] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:36.380929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.382317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.382317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.402018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:36.403623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:36.415569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:36.417816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.418105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.418383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.419811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:36.422021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:36.423726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 135/269] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:36 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:36.429651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:36.459149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:36.536943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 135/270] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:36.573702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:36.605253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31606eb9-08bc-4a2f-a4bc-b1653a452e89 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:36.648966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:36.649727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.649911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.650175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.651021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] RBAC: Adding query filter params (role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=dd134f4f992c49a1890ba612446f760b) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:36.651333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:36.652851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fb0ad-1163-415c-8414-3b5b2b9fb0e0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:36.661860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 136/271] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:36 2022] GET /identity/v3/role_assignments?user.id=dd134f4f992c49a1890ba612446f760b&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:36.663495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1d29-a217-4aac-81fc-54b5a10f5192 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.663783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1d29-a217-4aac-81fc-54b5a10f5192 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.664698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f1d29-a217-4aac-81fc-54b5a10f5192 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.666418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 137/272] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:36.672406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.672994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.673471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.705976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32bf7-eb00-4e59-97b5-a620654bf247 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:36.708896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:36.711854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:36.742197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:36.774594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:36.775417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.775702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.775998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.801272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:36.809369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:36.810710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:36.811552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 136/273] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:36.816627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:36.853339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 138/274] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:36.887711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:36.898968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:36.952482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa6a2a-8857-48ea-b5ed-b8e227b9388a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:36.987886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:36.988691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:36.988981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:36.989257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:36.990012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:36.990319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:36.991816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:37.001402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:37.004276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6b686-fe32-45f0-977e-4d16b487aefb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.011365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.045626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.046485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.046768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.047041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.048289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:37.049953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:37.056073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:37.057891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.069549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:37.153617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde93fd3-a205-4f3e-a5ad-526c0afa2a38 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.156628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:37.183662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1d385-6724-4c65-8278-5aa8ed71d60e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.188282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315fdd8-d12d-407f-a508-77cd848d43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.189155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fdd8-d12d-407f-a508-77cd848d43f4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.189439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fdd8-d12d-407f-a508-77cd848d43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.189717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315fdd8-d12d-407f-a508-77cd848d43f4 None admin] PATH_INFO: `/v3/users/ac20e444caed4c4cb82193f8d4eed849` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.204393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fdd8-d12d-407f-a508-77cd848d43f4 None admin] RBAC: Authorizing `identity:get_user(user_id=ac20e444caed4c4cb82193f8d4eed849)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:37.205875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315fdd8-d12d-407f-a508-77cd848d43f4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:37.212655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 138/277] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/users/ac20e444caed4c4cb82193f8d4eed849 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:37.212655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de1fde-9332-4f68-8c0e-81cd5a708249 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.212655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de1fde-9332-4f68-8c0e-81cd5a708249 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.212655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de1fde-9332-4f68-8c0e-81cd5a708249 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.212655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 139/278] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:37.214552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de1fde-9332-4f68-8c0e-81cd5a708249 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.226869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a85e7e-e2c2-4c37-9cad-01e2f0370925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.227533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85e7e-e2c2-4c37-9cad-01e2f0370925 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.227865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85e7e-e2c2-4c37-9cad-01e2f0370925 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.228181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a85e7e-e2c2-4c37-9cad-01e2f0370925 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.228915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85e7e-e2c2-4c37-9cad-01e2f0370925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:37.230336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a85e7e-e2c2-4c37-9cad-01e2f0370925 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:37.251381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 140/279] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:45:37 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:37.252679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.253120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.253283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.275450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:37.276698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:37.332074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:37.338222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de1fde-9332-4f68-8c0e-81cd5a708249 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.374456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 141/280] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:37.385688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.386462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.386752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.387032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.388005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, user.id=ac20e444caed4c4cb82193f8d4eed849, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:37.388325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:37.390018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f7c78-f5fa-4212-a353-45d4945dd94d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:37.396440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 140/281] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/role_assignments?user.id=ac20e444caed4c4cb82193f8d4eed849&scope.system=all&role.id=423552284f2a4983b5eef8fc699e5515 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:37.396887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.468919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:37.516085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11581bb0-87e4-44ff-9ff4-17a7997f269c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.537382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0bcaf-df2c-437c-bec4-3535f5e1d736 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.537833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0bcaf-df2c-437c-bec4-3535f5e1d736 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.538203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0bcaf-df2c-437c-bec4-3535f5e1d736 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.540329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 141/282] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:37.546791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.547072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.547347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.558971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.559775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.560126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.560404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.570909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:37.571955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:37.572194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:37.579822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:37.580775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:37.582120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 142/283] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:37.588071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.662224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 142/284] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:37.687685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.714171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020fe8-86ca-44c5-bcd6-5731a7f98a4e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.743991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:37.754210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.755169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.755458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.756012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.757203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:37.758171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:37.759768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:37.772104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 143/285] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:37.779547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.797078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:37.806456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549e4d-25cc-46cd-a77e-5c18967a6a4f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:37.843299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:37.844157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:37.844508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:37.844853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:37.856917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:37.865143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:37.866041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:37.867715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 143/286] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:37.874404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:37.990569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0193b3-19b6-4daf-8943-0615a4ea9687 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.025563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db575c-ee46-4dda-8f55-78139fb9bde6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.061413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.062093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.062378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.062753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.063521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:38.063796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.063910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.064998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.065279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.065687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.066152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] PATH_INFO: `/v3/users/b3e64d244a364ae4a026f11f392f86d0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.072723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] RBAC: Authorizing `identity:get_user(user_id=b3e64d244a364ae4a026f11f392f86d0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.074468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:38.074754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.076716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 144/288] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:37 2022] GET /identity/v3/users/b3e64d244a364ae4a026f11f392f86d0 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:38.082168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:38.082897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:38.108953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:38.150102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:38.225801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc083bd-495a-4907-a1da-a3e16971e481 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.279649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f3836-4a66-4630-b42e-cb96af32bc44 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.291024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.291910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.292348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.292729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] PATH_INFO: `/v3/users/8d6edd1d2d834152b3a34ce3ca83cb33` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.294468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] RBAC: Authorizing `identity:get_user(user_id=8d6edd1d2d834152b3a34ce3ca83cb33)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.296771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.299048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 145/289] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:38 2022] GET /identity/v3/users/8d6edd1d2d834152b3a34ce3ca83cb33 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:38.306555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:38.345783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.346921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.347205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.347483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.349642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.352978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.354984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 145/290] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:38 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:38.360278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:38.476341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:38.493025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5dde2-c22c-47d1-b4b4-800ba15dc949 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.508489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197961eb-54d5-498c-9ffe-2c9398301e9a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.524968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:38.554922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.555577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.555858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.556158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.560061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.560961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.561242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.561524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692/users/b3e64d244a364ae4a026f11f392f86d0/roles/38566b038de048beacd378c8d30e46db` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.570769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] RBAC: Authorizing `identity:create_grant(project_id=279158339e1e4648ac9028e333ebd692, user_id=b3e64d244a364ae4a026f11f392f86d0, role_id=38566b038de048beacd378c8d30e46db)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.572429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.590424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 146/291] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:45:38 2022] PUT /identity/v3/projects/279158339e1e4648ac9028e333ebd692/users/b3e64d244a364ae4a026f11f392f86d0/roles/38566b038de048beacd378c8d30e46db => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:38.691940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.693537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.809219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 146/292] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:38.815907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:38.931869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da6588-9057-4968-a36c-7e1400a7cdfb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:38.966708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184b50c-16e0-4537-9dff-f524249b1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:38.967847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184b50c-16e0-4537-9dff-f524249b1cad None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:38.968340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184b50c-16e0-4537-9dff-f524249b1cad None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:38.968804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184b50c-16e0-4537-9dff-f524249b1cad None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:38.970168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184b50c-16e0-4537-9dff-f524249b1cad None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:38.972199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184b50c-16e0-4537-9dff-f524249b1cad None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:38.974382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 147/293] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:38 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:38.981049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:39.006099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:39.115597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fceeb-fdbd-42b0-ab7e-759038be1103 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:39.160394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:39.161050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.161333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.161609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.162434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=8d6edd1d2d834152b3a34ce3ca83cb33) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:39.162746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:39.164721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9817e-9fb7-4504-af12-d7033137401a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:39.176332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 147/294] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:38 2022] GET /identity/v3/role_assignments?user.id=8d6edd1d2d834152b3a34ce3ca83cb33&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=423552284f2a4983b5eef8fc699e5515 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:39.827917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4704f9-10e5-4d6c-a428-267a876ec5cd None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.828439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4704f9-10e5-4d6c-a428-267a876ec5cd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.828513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4704f9-10e5-4d6c-a428-267a876ec5cd None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.830040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 148/295] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:39.836561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27939869-e65f-4547-9f35-0b9607c78877 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.836985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27939869-e65f-4547-9f35-0b9607c78877 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.837156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27939869-e65f-4547-9f35-0b9607c78877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.857182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-27939869-e65f-4547-9f35-0b9607c78877 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:39.858362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-27939869-e65f-4547-9f35-0b9607c78877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:39.903546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4a63e-3594-46c5-ad1d-b503e75012b8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.903851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4a63e-3594-46c5-ad1d-b503e75012b8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.904145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4a63e-3594-46c5-ad1d-b503e75012b8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.905756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 149/296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:45:39.910668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.910954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.911233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.935107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:39.935783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 148/297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:39.936327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:39.937038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f30a4-2bba-404f-b87a-bb89f05605f9 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.937322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f30a4-2bba-404f-b87a-bb89f05605f9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.937596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f30a4-2bba-404f-b87a-bb89f05605f9 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.938860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 149/298] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:39.940484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:39.944017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:39.944308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:39.944588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:39.962368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:39.963529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:39.970943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.011526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 150/299] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:40.012213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.045566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 150/300] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:40.046408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.139860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab367c2-758a-4c8e-b27b-c6768a6fec56 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.152107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581ccdd-c794-47fb-aaca-eff5a4e4d668 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.175953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.176771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.177051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.177327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.186331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.187234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.188041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.188472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.188798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.190002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:40.198637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:40.199076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:40.199945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:40.200767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 151/301] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:40.201439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:40.206494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:40.207382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:40.208279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 151/302] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:40.208952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.214380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.317349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2953915-4d50-4c33-ba39-c23a70ddd858 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.317533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee894b-e6f9-4424-b777-a2247903e93a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.352957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.353686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.353971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.354248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.354439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.355286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.355388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.355960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.356464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.356866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.357615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:40.358116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.358488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 152/303] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:40.359244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.360193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.370620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 152/304] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:40.371638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.437717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.442961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.474074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6142b-e330-40dc-8086-4ba896f36d93 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.486950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490726f-fa1d-456b-9d53-71d487c2ef9f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.514723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.515390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.515677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.515965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.516740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:40.517054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.518435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.521158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.522038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.522517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.522986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] PATH_INFO: `/v3/groups` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.524429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.526071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.527260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 153/305] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:40.528282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.545549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 153/306] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jun 21 09:45:40 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:45:40.546421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.681080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9ba15-c9e1-4705-b729-18d55464f943 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.686947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2983-3009-4661-a7bd-8c637f49c52f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.718706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.720635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:40.731776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.732712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.732988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.733272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] PATH_INFO: `/v3/users/ac20e444caed4c4cb82193f8d4eed849` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.733373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.734205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.734425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] RBAC: Authorizing `identity:get_user(user_id=ac20e444caed4c4cb82193f8d4eed849)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.734937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.735402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] PATH_INFO: `/v3/users/66390b5b072a4b7a8dc6b78869bc75c9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.735889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.737553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 154/307] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/users/ac20e444caed4c4cb82193f8d4eed849 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:40.744621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.751884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] RBAC: Authorizing `identity:get_user(user_id=66390b5b072a4b7a8dc6b78869bc75c9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.753431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.755817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 154/308] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/users/66390b5b072a4b7a8dc6b78869bc75c9 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:40.762792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:40.856739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6b41-18c1-4fc3-9c04-36744131a311 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.891201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf47a9-9da1-4dfb-bb03-41dde7bf9145 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:40.900868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c87cff-77fe-46e0-8aac-6cbf5d849952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.902425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c87cff-77fe-46e0-8aac-6cbf5d849952 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.903271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c87cff-77fe-46e0-8aac-6cbf5d849952 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.903733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c87cff-77fe-46e0-8aac-6cbf5d849952 None admin] PATH_INFO: `/v3/system/users/ac20e444caed4c4cb82193f8d4eed849/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.905939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c87cff-77fe-46e0-8aac-6cbf5d849952 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac20e444caed4c4cb82193f8d4eed849, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.908363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c87cff-77fe-46e0-8aac-6cbf5d849952 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.921941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 155/309] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jun 21 09:45:40 2022] PUT /identity/v3/system/users/ac20e444caed4c4cb82193f8d4eed849/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:40.938122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:40.938921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:40.939336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:40.939713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:40.940790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] RBAC: Adding query filter params (role.id=38566b038de048beacd378c8d30e46db, user.id=66390b5b072a4b7a8dc6b78869bc75c9, scope.system=all) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:40.941250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:40.942897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e12bed-09ac-4193-be9f-32b49de2674f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:40.950166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 155/310] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 09:45:40 2022] GET /identity/v3/role_assignments?user.id=66390b5b072a4b7a8dc6b78869bc75c9&scope.system=all&role.id=38566b038de048beacd378c8d30e46db => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:41.040854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfc0f5-d2db-465e-991c-697b5d16dbac None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:41.041512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfc0f5-d2db-465e-991c-697b5d16dbac None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:41.041993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfc0f5-d2db-465e-991c-697b5d16dbac None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:41.043699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 156/311] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:41.049884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:41.050533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:41.051056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:41.069959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:41.071657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:41.129809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:41.157544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 156/312] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:41.181463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfc0f5-d2db-465e-991c-697b5d16dbac None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:41.250945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:41.292974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfc0f5-d2db-465e-991c-697b5d16dbac None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:41.327699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:41.328755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:41.329177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:41.329590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:41.340996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:41.349192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:41.350228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:41.351204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:41.353905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:41.362232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:41.464904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17711f7b-2e10-4b78-8615-d5167f4c1496 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:41.501506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:41.502106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:41.502391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:41.502667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:41.503417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:41.503725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:41.505136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:41.518306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:41.519621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:41.622590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26668-d145-438e-b527-60e97723c0a7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:41.645568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:41.658369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:41.659250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:41.659537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:41.659818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] PATH_INFO: `/v3/users/b3e64d244a364ae4a026f11f392f86d0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:41.661052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] RBAC: Authorizing `identity:get_user(user_id=b3e64d244a364ae4a026f11f392f86d0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:41.662491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:41.664703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:41 2022] GET /identity/v3/users/b3e64d244a364ae4a026f11f392f86d0 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:41.670305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:41.716987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:41.781624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcd139-4cda-46f1-9845-c31ac245de0f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:41.819708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:41.820415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:41.820697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:41.820978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:41.889641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:41.891107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:41.929734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:41.992429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:41.997860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:42.103289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14719a-d4ea-4eab-91c3-8608f85c7b90 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:42.139735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8c2cc-227e-4748-9246-2a0f2fe7df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:42.140655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8c2cc-227e-4748-9246-2a0f2fe7df4a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:42.140942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8c2cc-227e-4748-9246-2a0f2fe7df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:42.141217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8c2cc-227e-4748-9246-2a0f2fe7df4a None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:42.142520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8c2cc-227e-4748-9246-2a0f2fe7df4a None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:42.144006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8c2cc-227e-4748-9246-2a0f2fe7df4a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:42.146138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 159/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:41 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:42.152447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:42.255751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4fc9f-ece4-41db-a43b-619448f84611 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:42.289976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:42.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:42.290930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:42.291210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:42.292074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] RBAC: Adding query filter params (role.id=38566b038de048beacd378c8d30e46db, scope.project.id=279158339e1e4648ac9028e333ebd692, user.id=b3e64d244a364ae4a026f11f392f86d0) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:42.292393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:42.294008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499f4f-49a7-447e-8c9a-5cc4d644e867 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:42.304092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 159/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:45:42 2022] GET /identity/v3/role_assignments?user.id=b3e64d244a364ae4a026f11f392f86d0&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=38566b038de048beacd378c8d30e46db => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:42.808728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693d1d-704b-4c27-a326-69422ec6937d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:42.809163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693d1d-704b-4c27-a326-69422ec6937d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:42.809293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693d1d-704b-4c27-a326-69422ec6937d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:42.810993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 160/319] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:42.816585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015affd2-e3c1-4cec-b213-ae33b08d19c3 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:42.817113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015affd2-e3c1-4cec-b213-ae33b08d19c3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:42.817613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015affd2-e3c1-4cec-b213-ae33b08d19c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:42.823566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:42.836649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-015affd2-e3c1-4cec-b213-ae33b08d19c3 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:42.838134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-015affd2-e3c1-4cec-b213-ae33b08d19c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:42.906105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 160/320] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:42.929268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08693d1d-704b-4c27-a326-69422ec6937d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:42.990738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.034653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08693d1d-704b-4c27-a326-69422ec6937d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.063205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302ebd-1a29-4a72-9d9c-33c377c0ed51 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.063686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302ebd-1a29-4a72-9d9c-33c377c0ed51 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.063686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302ebd-1a29-4a72-9d9c-33c377c0ed51 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.065094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 161/321] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:43.069695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232707cf-baa4-418d-a579-5e7b88174e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.069884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b279-571f-4ac1-a74f-80751f1b504d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.070378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b279-571f-4ac1-a74f-80751f1b504d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.070543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232707cf-baa4-418d-a579-5e7b88174e81 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.070649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3b279-571f-4ac1-a74f-80751f1b504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.070805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232707cf-baa4-418d-a579-5e7b88174e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.071073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232707cf-baa4-418d-a579-5e7b88174e81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.072318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232707cf-baa4-418d-a579-5e7b88174e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:43.073707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232707cf-baa4-418d-a579-5e7b88174e81 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:43.075498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 161/322] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:43.077399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d0d4-43aa-4fbd-85dc-dd246495f686 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.077692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d0d4-43aa-4fbd-85dc-dd246495f686 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.077975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7d0d4-43aa-4fbd-85dc-dd246495f686 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.079379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 162/323] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:43.080539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d0d4-43aa-4fbd-85dc-dd246495f686 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.087459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-efe3b279-571f-4ac1-a74f-80751f1b504d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:43.088696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-efe3b279-571f-4ac1-a74f-80751f1b504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:43.154602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 162/324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:43.156169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.156460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.156746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.173469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:43.174810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:43.185893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7d0d4-43aa-4fbd-85dc-dd246495f686 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.210448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.219295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.220083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.220441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.220789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] PATH_INFO: `/v3/groups` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.221799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:43.223306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:43.231335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.238243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 163/325] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Jun 21 09:45:43 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:45:43.239041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.249078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 163/326] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:43.272302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.364015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fa82-4cf1-4a05-9aeb-2703c9e0008f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.386372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076ced-fecb-4f8b-bb10-221ff339c3b0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.398798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.399959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.399959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.400168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.412930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:43.421187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:43.422063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:43.422872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 164/327] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:43.427952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.428771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.429532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.430400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.430400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.441946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:43.450089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:43.451022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:43.451788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 164/328] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:43.457658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.484667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.516762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.559607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f29210-3823-483a-a4bd-c3e55b129b1b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.579256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1231f9-e8da-4fee-9703-5e7a38399d46 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.616579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.616579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.616838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.617097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.617849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:43.618160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:43.619555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:43.628828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 165/329] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:43.629007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.629691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.629977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.630254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.631006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:43.631314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:43.633411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:43.634467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.642822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 165/330] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:43.648905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.766165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18cf09-8e72-47fc-ab57-8b04a209524f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.782397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.793277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f995b6b-adcf-460e-b459-6e5814c7be13 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:43.809807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:43.817139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.818034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.818317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.818591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] PATH_INFO: `/v3/users/ac20e444caed4c4cb82193f8d4eed849` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.819820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] RBAC: Authorizing `identity:get_user(user_id=ac20e444caed4c4cb82193f8d4eed849)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:43.821981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:43.823963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 166/331] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/users/ac20e444caed4c4cb82193f8d4eed849 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:43.829481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.847585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:43.848838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:43.849362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:43.849816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] PATH_INFO: `/v3/users/66390b5b072a4b7a8dc6b78869bc75c9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:43.851855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] RBAC: Authorizing `identity:get_user(user_id=66390b5b072a4b7a8dc6b78869bc75c9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:43.853483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:43.855444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/users/66390b5b072a4b7a8dc6b78869bc75c9 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:43.862305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:43.977479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83981e-d48d-42b3-8ee6-f55ebabaadab None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:44.003441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da2a67-9893-4c99-9268-7458d0b285f7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:44.030021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:44.031799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:44.031799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:44.031799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:44.032700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] RBAC: Adding query filter params (role.id=423552284f2a4983b5eef8fc699e5515, user.id=ac20e444caed4c4cb82193f8d4eed849, scope.system=all) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:44.033017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:44.034739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60961d8-ac15-42f0-848d-8576ee037c54 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:44.048520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a995113-42b5-4230-8940-e4240d00736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:44.049720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995113-42b5-4230-8940-e4240d00736d None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:44.050219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995113-42b5-4230-8940-e4240d00736d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:44.050702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a995113-42b5-4230-8940-e4240d00736d None admin] PATH_INFO: `/v3/system/users/66390b5b072a4b7a8dc6b78869bc75c9/roles/38566b038de048beacd378c8d30e46db` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:44.051177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 167/333] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 09:45:43 2022] GET /identity/v3/role_assignments?user.id=ac20e444caed4c4cb82193f8d4eed849&scope.system=all&role.id=423552284f2a4983b5eef8fc699e5515 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:44.052687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a995113-42b5-4230-8940-e4240d00736d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66390b5b072a4b7a8dc6b78869bc75c9, role_id=38566b038de048beacd378c8d30e46db)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:44.054179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a995113-42b5-4230-8940-e4240d00736d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:44.076992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 167/334] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Jun 21 09:45:43 2022] PUT /identity/v3/system/users/66390b5b072a4b7a8dc6b78869bc75c9/roles/38566b038de048beacd378c8d30e46db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:45.939499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75e3fd-ba75-4155-9f6e-cba3a7b4f41c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:45.940035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75e3fd-ba75-4155-9f6e-cba3a7b4f41c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:45.940112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75e3fd-ba75-4155-9f6e-cba3a7b4f41c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:45.941772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 168/335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:45.946981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e91e-0455-4f7c-aa4b-198e6b668a19 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:45.947431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e91e-0455-4f7c-aa4b-198e6b668a19 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:45.947604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e91e-0455-4f7c-aa4b-198e6b668a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:45.965273 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-bde4e91e-0455-4f7c-aa4b-198e6b668a19 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:45.966469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bde4e91e-0455-4f7c-aa4b-198e6b668a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:46.022343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:46.056957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:46.114260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75e3fd-ba75-4155-9f6e-cba3a7b4f41c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:46.157083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833c36-2e6e-4a72-a876-0415d6792ed7 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:46.157722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833c36-2e6e-4a72-a876-0415d6792ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:46.158194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833c36-2e6e-4a72-a876-0415d6792ed7 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:46.163534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:46.164178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 169/337] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:46.165680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:46.166162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:46.166630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:46.202493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:46.203968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:46.262540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75e3fd-ba75-4155-9f6e-cba3a7b4f41c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:46.324807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:46.325852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:46.326303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:46.326717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:46.351342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:46.359901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:46.360818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:46.361596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:46.366664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 169/338] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:46.375290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:46.376613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 170/339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:46.402672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:46.491878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:46.501351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d61a0-8958-4578-95f6-dee9d70285f9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:46.564769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:46.565449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:46.565736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:46.566014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:46.566775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:46.567085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:46.569928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:46.589933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 170/340] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:46.594680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:46.602893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dd41d-e503-4b4d-b93a-e8e46a1a7013 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:46.620350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:46.658529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:46.659368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:46.659649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:46.659926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:46.677766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:46.694423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:46.695891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:46.696694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 171/341] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:46.703335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:46.723380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6531-89ff-46a5-bf26-9e052781ad53 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:46.768905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e68e-c323-445c-9f11-c3b6c8341eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:46.769490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e68e-c323-445c-9f11-c3b6c8341eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:46.769830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e68e-c323-445c-9f11-c3b6c8341eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:46.770116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e68e-c323-445c-9f11-c3b6c8341eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:46.817280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:46.876313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196e68e-c323-445c-9f11-c3b6c8341eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:46.877802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a196e68e-c323-445c-9f11-c3b6c8341eb3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:46.938772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e013af8-7df8-4558-b992-ffa0e495542c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.014507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 171/342] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:47.016570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa68606-1cdb-42f3-9330-14f190f9980f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.017076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa68606-1cdb-42f3-9330-14f190f9980f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.017554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa68606-1cdb-42f3-9330-14f190f9980f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.019366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 172/343] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:47.020269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa68606-1cdb-42f3-9330-14f190f9980f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.024079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.024079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.024079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.024079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.024682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:47.024682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:47.025986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e34ad-fdf2-476e-b905-b1f9b8f58781 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:47.038922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 172/344] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:47.044610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.044905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.045193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.081057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:47.082340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:47.091171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:47.118472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:47.144250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa68606-1cdb-42f3-9330-14f190f9980f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.210485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 173/345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:47.212137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.214158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.215260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.217470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.217965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.219344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:47.222017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:47.227947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 173/346] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:47.232982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.349026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e58c9-0fe2-45f9-8f8b-5bc3db5afb27 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.368841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2fe8-8576-46e8-bf8e-2880b0f7a010 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.379593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:47.394611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.395612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.396020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.396406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.403425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:47.405296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:47.412077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 174/347] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:47.412077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.423176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c995e-6d79-4874-b0db-9f14bbd30a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.423824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c995e-6d79-4874-b0db-9f14bbd30a5c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.424152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c995e-6d79-4874-b0db-9f14bbd30a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.424424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c995e-6d79-4874-b0db-9f14bbd30a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.460423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:47.515732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c995e-6d79-4874-b0db-9f14bbd30a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:47.517259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c995e-6d79-4874-b0db-9f14bbd30a5c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:47.545608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901c63-871f-4a43-8861-df395bd393e2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.593769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea849239-b941-4430-9b95-c78f9e0ac87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.594586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea849239-b941-4430-9b95-c78f9e0ac87b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.594873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea849239-b941-4430-9b95-c78f9e0ac87b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.595155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea849239-b941-4430-9b95-c78f9e0ac87b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.609738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea849239-b941-4430-9b95-c78f9e0ac87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ea849239-b941-4430-9b95-c78f9e0ac87b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:47.619901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:47.620945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 175/348] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:47.622464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e05d-b32b-4562-b057-814543bd5e12 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.623190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e05d-b32b-4562-b057-814543bd5e12 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.623190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e05d-b32b-4562-b057-814543bd5e12 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.624693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 176/349] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:47.625388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e05d-b32b-4562-b057-814543bd5e12 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.642244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 174/350] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:47.643947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816f41-dc06-46a5-8baa-ad8af3771638 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.644490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816f41-dc06-46a5-8baa-ad8af3771638 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.644946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816f41-dc06-46a5-8baa-ad8af3771638 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.650539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 175/351] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:47.651564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816f41-dc06-46a5-8baa-ad8af3771638 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.688091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:47.728524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:47.751267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9e05d-b32b-4562-b057-814543bd5e12 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.775531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816f41-dc06-46a5-8baa-ad8af3771638 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.792852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.793570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.793863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.794142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.794990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:47.795374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:47.797054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d35838-f93f-459a-a8e1-3a0281162d74 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:47.803281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 177/352] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:47.804337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c480-e84d-4a99-8f93-913994086869 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.804672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c480-e84d-4a99-8f93-913994086869 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.804946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c480-e84d-4a99-8f93-913994086869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.815148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:47.816022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.816568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.816909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.817826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:47.818226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:47.819704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:47.823766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-15f9c480-e84d-4a99-8f93-913994086869 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:47.825289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-15f9c480-e84d-4a99-8f93-913994086869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:47.832117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 176/353] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:47.832117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:47.921264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 178/354] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:47.922790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dc7fc-7213-48e7-8a42-f05a7759d0e4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:47.923224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dc7fc-7213-48e7-8a42-f05a7759d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:47.923640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dc7fc-7213-48e7-8a42-f05a7759d0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:47.942182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-be9dc7fc-7213-48e7-8a42-f05a7759d0e4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:47.943629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-be9dc7fc-7213-48e7-8a42-f05a7759d0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:47.974990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333eeed-65f3-4f59-a05d-79f1aab5ffa9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:47.986744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.002615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.020809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.021686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.023022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.023846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.025922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:48.027366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:48.030501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 179/355] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:48.030903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445620-52d0-400c-aa2f-c6ffa9cb7a8c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.030903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445620-52d0-400c-aa2f-c6ffa9cb7a8c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.031169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445620-52d0-400c-aa2f-c6ffa9cb7a8c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.032360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 177/356] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:47 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:48.032713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 180/357] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:48.033409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445620-52d0-400c-aa2f-c6ffa9cb7a8c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.033975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.172268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445620-52d0-400c-aa2f-c6ffa9cb7a8c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.174442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d9eb-ae7e-418f-9cd8-34954e573b5b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.213367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff29dd5-e20e-4417-9b82-843f1af5f404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.214531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff29dd5-e20e-4417-9b82-843f1af5f404 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.215013 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff29dd5-e20e-4417-9b82-843f1af5f404 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.215116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.215592 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff29dd5-e20e-4417-9b82-843f1af5f404 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.215707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.216041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.216300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.227735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff29dd5-e20e-4417-9b82-843f1af5f404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5ff29dd5-e20e-4417-9b82-843f1af5f404 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:48.236460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:48.237373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:48.238148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 181/358] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:48.243607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.243607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.243607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.259153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:48.260488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:48.295065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.299002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.315352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:48.317323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:48.352558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 182/359] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:48.353817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.438703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 178/360] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:48.440457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.488541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d4e93-9c9c-494d-9535-ae91faff5665 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.535068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.535943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.536298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.536578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.537777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:48.540002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:48.543008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 183/361] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:48.543810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.555501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.573475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9fb61-ab98-4ca7-b6d8-25739328756f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.580590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.621182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.621994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.622275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.622818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.637655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:48.646432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:48.647298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:48.648187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 179/362] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:48.648853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.673333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6ff0b-8312-4357-b280-6e00859d86d5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.716084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.716084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.716084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.716084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.719879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:48.719879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:48.719879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:48.728334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 184/363] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:48.729059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.770414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88722e-d2a6-4463-bc42-79f6d57b15d4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.811486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.812333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.812614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.812890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.829303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:48.837310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:48.838216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:48.839002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:48.839595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 180/364] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:48.843997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.854303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.856668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:48.868852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28323d15-a12e-4181-a7a0-419cdec46f95 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:48.915483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:48.916786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:48.917250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:48.917972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:48.919232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:48.921229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:48.923600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 185/365] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:48.924404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:48.980668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21f0ad-fcd2-45bd-8a01-54083a9bb2d1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.023381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.024172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.024530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.024878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.025789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:49.026107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.027569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.040150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 181/366] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=423552284f2a4983b5eef8fc699e5515 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.041160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.049572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4844-1d1b-4a39-9acd-95fd154a54a0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.108004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.108004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.108004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.108004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.108427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:49.108427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.108427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.117621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 186/367] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.118772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.146391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:49.157257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:49.183469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ef7a5-9233-4594-a088-573b394ec5a3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.229747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.231204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.232188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.232675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] PATH_INFO: `/v3/users/66390b5b072a4b7a8dc6b78869bc75c9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.234516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] RBAC: Authorizing `identity:get_user(user_id=66390b5b072a4b7a8dc6b78869bc75c9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.236736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.239367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 182/368] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/users/66390b5b072a4b7a8dc6b78869bc75c9 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.240638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.260644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3cbb-4a5b-4ae2-b858-d454f70694f0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.318616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.320850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.321494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.322021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.323184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:49.323936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.326135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.338504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 187/369] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.339724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.377653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b23ad-aa9b-4121-b439-3e4df7e1e007 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.426578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.428077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.428586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.429318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.432441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.434096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.436502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 183/370] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.437475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.449335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:49.474361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343b9b-d6ed-44e4-9ce8-4b292fa17447 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.476363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:49.512529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.513087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.513384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.513741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.575744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad95630-20a0-4156-a5c3-6e807ee52149 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.593409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.594883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.629411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.630524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.631270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.632206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.634102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] RBAC: Adding query filter params (role.id=38566b038de048beacd378c8d30e46db, user.id=66390b5b072a4b7a8dc6b78869bc75c9, scope.system=all) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:49.634889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.637266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.652929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 184/371] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/role_assignments?user.id=66390b5b072a4b7a8dc6b78869bc75c9&scope.system=all&role.id=38566b038de048beacd378c8d30e46db => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.654621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.723704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:49.736369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:49.748641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 188/372] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:49.749919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.776961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fa423-c982-47db-ad67-3dfadcf41ed5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.833458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93d25-2896-4cc5-a311-eafb203cb52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.834121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93d25-2896-4cc5-a311-eafb203cb52b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.834400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93d25-2896-4cc5-a311-eafb203cb52b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.834676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93d25-2896-4cc5-a311-eafb203cb52b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.912171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a09a1c-256f-4639-be62-8742fda98213 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:49.955913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:49.956610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:49.956892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:49.957173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:49.958003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=279158339e1e4648ac9028e333ebd692) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:49.958314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.959749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:49.966894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 189/373] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=423552284f2a4983b5eef8fc699e5515 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:49.967707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:49.990008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93d25-2896-4cc5-a311-eafb203cb52b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:49.992787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93d25-2896-4cc5-a311-eafb203cb52b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.058366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:50.141561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f9f44-73f2-409f-82e0-5c1fa3ed3079 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.150216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:50.192596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.193726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.194180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.194460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.196392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:50.197841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.198627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 185/374] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:50.199820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 190/375] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:49 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:50.201481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cc23-6ab9-458f-9e9b-4544f770bb3b None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.201776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cc23-6ab9-458f-9e9b-4544f770bb3b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.202056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cc23-6ab9-458f-9e9b-4544f770bb3b None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.203447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 186/376] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:50.204317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.207917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cc23-6ab9-458f-9e9b-4544f770bb3b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.343366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cc23-6ab9-458f-9e9b-4544f770bb3b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.345641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094bb08-2f3d-465e-8415-68705cfbfda4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.369200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:50.393910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec12cb-4693-4b75-9ed9-7ea3f1d40284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.394770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec12cb-4693-4b75-9ed9-7ea3f1d40284 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.395045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec12cb-4693-4b75-9ed9-7ea3f1d40284 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.395318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec12cb-4693-4b75-9ed9-7ea3f1d40284 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.396015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.396542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec12cb-4693-4b75-9ed9-7ea3f1d40284 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:50.397308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.397777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.397980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec12cb-4693-4b75-9ed9-7ea3f1d40284 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.398466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] PATH_INFO: `/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.399862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] RBAC: Authorizing `identity:get_project(project_id=7f168e0b349b4ecc9d941ccf0785ad5d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:50.399997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 187/377] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:50.401628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.401736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.401950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.402226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.410204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 191/378] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:50.410204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.434066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:50.435564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:50.479118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:50.536333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 188/379] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:50.537605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.557666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bdcb03-088d-440e-8bf4-263e23567782 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.610681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.611658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.612273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.612690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.614262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=279158339e1e4648ac9028e333ebd692) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:50.614722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:50.616806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.624740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 192/380] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:50.625920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.673926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421593b-8774-4b16-a3ec-b08306ce6c07 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.708680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:50.722760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.723670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.724029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.724398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] PATH_INFO: `/v3/groups/57303fc133424ce49e41286ac1e91ab0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.740930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] RBAC: Authorizing `identity:get_group(group_id=57303fc133424ce49e41286ac1e91ab0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:50.743305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.745315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 189/381] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/groups/57303fc133424ce49e41286ac1e91ab0 => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:50.757921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.806919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:50.816764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba659ffe-b4be-476e-9dd1-48cc3c063d4e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.894259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.895009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.895292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.895569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.921062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:50.930172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:50.931056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:50.932227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:50.933198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 193/382] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:50.934851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a0342-a6c7-491d-84a8-dc1974bd4549 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:50.939131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:50.975152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:50.976240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:50.977309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:50.977785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:50.978810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] RBAC: Adding query filter params (group.id=57303fc133424ce49e41286ac1e91ab0, role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=7f168e0b349b4ecc9d941ccf0785ad5d) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:50.979314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:50.981679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:50.998320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 190/383] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/role_assignments?group.id=57303fc133424ce49e41286ac1e91ab0&scope.project.id=7f168e0b349b4ecc9d941ccf0785ad5d&role.id=7adf0608488a4c0780e809cd640a911c => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:51.106339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b146c-3c2a-4e3b-9798-1725630c115f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:51.126608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:51.163910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:51.164537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.164819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.165099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.165867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:51.166174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:51.167588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:51.180606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 194/384] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:51.185923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:51.292944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:51.299894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967dec9-836a-454d-ae59-db67417f71fe None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:51.334736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85856e-d69b-4f92-a22d-5611a1e90a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:51.335653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85856e-d69b-4f92-a22d-5611a1e90a6d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.336527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85856e-d69b-4f92-a22d-5611a1e90a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.336802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85856e-d69b-4f92-a22d-5611a1e90a6d None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.337997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85856e-d69b-4f92-a22d-5611a1e90a6d None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:51.339450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85856e-d69b-4f92-a22d-5611a1e90a6d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:51.341430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 191/385] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:51 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:51.349131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:51.471615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ed278-58f3-47ea-8ac1-91fc7d76a969 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:51.501994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162bd09-cfac-4861-ac1c-73c7f337b1c4 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.502304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162bd09-cfac-4861-ac1c-73c7f337b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.502545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162bd09-cfac-4861-ac1c-73c7f337b1c4 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.504191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 192/386] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:51.506359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:51.507224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.507614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.508395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.509566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:51.509808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.510105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.510387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.511006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:51.513081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 195/387] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:51 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:51.521357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:51.542711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:51.543900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:51.594797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:51.672750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 193/388] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:51.711715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:51.712491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bb2fd-5211-4110-ad5d-690280619060 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:51.784380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:51.785193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.785475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.785751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/groups/537d642dc4734431b8e8bb32f81c7a30/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.789664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c907e05824b55afd1b5fdd114a1a5, group_id=537d642dc4734431b8e8bb32f81c7a30, role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:51.791105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:51.815740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 196/389] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 09:45:51 2022] PUT /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/groups/537d642dc4734431b8e8bb32f81c7a30/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:51.867450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:51.878250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17856c-bae0-451c-923c-1e95d6a07d37 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:51.924364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:51.925165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:51.925448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:51.925724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:51.940113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:51.947931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:51.948921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:51.950171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 194/390] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:51.955564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:52.062336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:52.066383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b776f8-5acf-4aa0-b24c-519fd5dc31de None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:52.111614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:52.112340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.112616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.112893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.113656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:52.113966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:52.115339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bfa54-968f-4126-93c5-54fc153eee6f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:52.125283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 197/391] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:52.130463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:52.252560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08ecbc-f018-482b-b28b-4bb41674ac6f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:52.266846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef69a-637a-45a3-b9f6-45c63d29eec5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.267145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef69a-637a-45a3-b9f6-45c63d29eec5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.267432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef69a-637a-45a3-b9f6-45c63d29eec5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.269056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 198/392] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:52.274816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.275111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.275392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.293003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:52.294265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:52.294893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:52.295753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.296053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.296332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.300686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:52.302146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:52.304142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 195/393] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:52 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:52.309291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:52.336537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:52.407671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 199/394] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:52.422674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937d1ec-956d-4837-bad8-549091912726 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:52.442979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:52.457552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:52.458411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.458690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.458963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.460183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:52.462156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:52.464153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 196/395] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:52 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:52.472953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:52.559721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:52.583096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3b1c0-3c18-4865-9a27-64945850d14f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:52.617543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:52.620924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:52.622494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.623082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.623554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/groups/537d642dc4734431b8e8bb32f81c7a30/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.627189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce9c907e05824b55afd1b5fdd114a1a5, group_id=537d642dc4734431b8e8bb32f81c7a30, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:52.628875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:52.643163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 197/396] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 09:45:52 2022] PUT /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5/groups/537d642dc4734431b8e8bb32f81c7a30/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:52.650300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abe9be-8d41-44b8-97df-ddf4ab893b7e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:52.717516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:52.718346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:52.718634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:52.718916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:52.745134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:52.763475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:52.764554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:52.765328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 200/397] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:52.770314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:52.966785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052c5d-d59c-4908-8c9e-1ecc4a5f2e13 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:53.003470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:53.004529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.005021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.005500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.006443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:53.006948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:53.008586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:53.017449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 198/398] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:53.024289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:53.227357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd1216-8dd1-4288-8157-48d4bea63b61 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:53.275886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:53.277296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.277856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.281135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.282734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:53.284491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:53.286697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 201/399] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:53 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:53.292625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:53.305213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:53.430937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ea1c1-c42f-4170-8b21-2bca1fd84402 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:53.491664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94127c71-7d30-4b28-884c-a2b254160f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:53.492510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94127c71-7d30-4b28-884c-a2b254160f34 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.492869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94127c71-7d30-4b28-884c-a2b254160f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.493258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94127c71-7d30-4b28-884c-a2b254160f34 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.499645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94127c71-7d30-4b28-884c-a2b254160f34 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:53.502158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94127c71-7d30-4b28-884c-a2b254160f34 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:53.503390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 199/400] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:53 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:53.509504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:53.543987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b07c-996f-46ed-ad2c-04f1d79900d6 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.544302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b07c-996f-46ed-ad2c-04f1d79900d6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.544549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85b07c-996f-46ed-ad2c-04f1d79900d6 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.545906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 200/401] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:53.547067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:53.551111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede288e-2acc-42d4-bc7b-a764e21e5102 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.551391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede288e-2acc-42d4-bc7b-a764e21e5102 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.551665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede288e-2acc-42d4-bc7b-a764e21e5102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.581004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6ede288e-2acc-42d4-bc7b-a764e21e5102 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:53.582192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6ede288e-2acc-42d4-bc7b-a764e21e5102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:53.675414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 201/402] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:53.676795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9abb68-9f99-4ad6-84cc-98f9565a695b None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.677086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9abb68-9f99-4ad6-84cc-98f9565a695b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.677367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9abb68-9f99-4ad6-84cc-98f9565a695b None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.678637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 202/403] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:53.684047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.684445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.684735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.688221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92f43a-0dc0-4024-b83e-6c3a8e442491 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:53.696602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:53.703814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:53.705044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:53.737880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:53.738834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:53.739048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:53.739361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692/groups/537d642dc4734431b8e8bb32f81c7a30/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:53.741380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=279158339e1e4648ac9028e333ebd692, group_id=537d642dc4734431b8e8bb32f81c7a30, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:53.743413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:53.760135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 202/404] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 09:45:53 2022] PUT /identity/v3/projects/279158339e1e4648ac9028e333ebd692/groups/537d642dc4734431b8e8bb32f81c7a30/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:45:53.768872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:53.790537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 203/405] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:53.838618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:53.944323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:53.969645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd55a2-79a4-46fa-9055-19518b7b9ae6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:53.996241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526bfb3-b80a-4950-94d7-46cc48bcfb42 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.022703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.023552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.023830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.024168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.044900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:54.062984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.063833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.064187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.064471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:54.065280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:54.066135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:54.066924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 203/406] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:54.073044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:54.077030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.082327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:54.090804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:54.091708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:54.092594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:54.095074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 204/407] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:54.105190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.263112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269eda4-1532-4f92-a111-a8a791f76624 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.283002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4480b-9d15-4924-837d-b266c55fea3e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.320330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.321307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.321760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.322070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.322371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.322746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.323027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.323302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.323783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:54.324077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:54.324386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.324555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.325753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.326231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.338189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 205/408] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:54.343179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:54.345308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.345755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 204/409] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:54.348790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.417749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:54.462862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4f3be-d656-4681-bbc3-6cd2a96765dc None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.477292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44bf5-c2a1-4b58-b5cf-b2494695bf8e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.499598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7b91-73cc-4d07-87b8-bb6937f2b9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.500816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7b91-73cc-4d07-87b8-bb6937f2b9ca None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.501294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7b91-73cc-4d07-87b8-bb6937f2b9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.501793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7b91-73cc-4d07-87b8-bb6937f2b9ca None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.503207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7b91-73cc-4d07-87b8-bb6937f2b9ca None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.506274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb7b91-73cc-4d07-87b8-bb6937f2b9ca None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.508556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 206/410] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:54.509944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b59f-83d3-4bf5-86b9-80fbe2efb29f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.510428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b59f-83d3-4bf5-86b9-80fbe2efb29f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.510898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b59f-83d3-4bf5-86b9-80fbe2efb29f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.512708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 207/411] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:54.513767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b59f-83d3-4bf5-86b9-80fbe2efb29f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.522981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2ebdf-e8d1-4a50-949a-269cf34d8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.524616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2ebdf-e8d1-4a50-949a-269cf34d8e30 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.525097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2ebdf-e8d1-4a50-949a-269cf34d8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.525535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2ebdf-e8d1-4a50-949a-269cf34d8e30 None admin] PATH_INFO: `/v3/groups/57303fc133424ce49e41286ac1e91ab0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.526907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2ebdf-e8d1-4a50-949a-269cf34d8e30 None admin] RBAC: Authorizing `identity:get_group(group_id=57303fc133424ce49e41286ac1e91ab0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.528526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2ebdf-e8d1-4a50-949a-269cf34d8e30 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.530358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 205/412] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/groups/57303fc133424ce49e41286ac1e91ab0 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:54.531691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.532266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.532738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.555742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:54.557268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:54.623814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 206/413] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:54.624326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:54.628540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.659233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b59f-83d3-4bf5-86b9-80fbe2efb29f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.694528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:54.706978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.707832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.708150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.708665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.711323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.712796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.714484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 208/414] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:54.715234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.744311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d64a4-7185-4244-ad98-e7b237160115 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.783218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.784432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.785010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.785494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] PATH_INFO: `/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.787062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] RBAC: Authorizing `identity:get_project(project_id=7f168e0b349b4ecc9d941ccf0785ad5d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.789371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.791790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 207/415] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:54.792797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.851140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2f46d-48c9-4af4-85b1-8fa73e99d23a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.869700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:54.897222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.898094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.898970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.899244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.912640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f68e18-fd03-41cc-9509-cfc566f34783 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:54.913469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:54.922801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:54.923698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:54.924530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:54.927177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 209/416] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:54.928222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.954613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:54.955496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:54.955775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:54.956060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692/groups/537d642dc4734431b8e8bb32f81c7a30/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:54.958332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=279158339e1e4648ac9028e333ebd692, group_id=537d642dc4734431b8e8bb32f81c7a30, role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:54.959780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:54.982562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 208/417] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 09:45:54 2022] PUT /identity/v3/projects/279158339e1e4648ac9028e333ebd692/groups/537d642dc4734431b8e8bb32f81c7a30/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:54.983473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:54.997489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:55.054015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793b5db-325d-436c-8e1d-3180ba1c4aa8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:55.114283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:55.115312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.115599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.115889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] PATH_INFO: `/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d/groups/57303fc133424ce49e41286ac1e91ab0/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.125080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f168e0b349b4ecc9d941ccf0785ad5d, group_id=57303fc133424ce49e41286ac1e91ab0, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:55.126568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:55.139944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543629e-5662-4660-99db-d473e6666c37 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:55.158372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 210/418] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Jun 21 09:45:54 2022] PUT /identity/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d/groups/57303fc133424ce49e41286ac1e91ab0/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:45:55.174590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:55.186631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:55.187730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.188259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.188759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.189776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:55.190352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:55.192050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa13e08-f4f1-409d-b1d9-3b09b8869445 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:55.203272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 209/419] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:55.213005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:55.333255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaad77-e01e-4bb1-9060-edc7ea495575 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:55.350325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:55.365580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343b65c-2b64-4c6a-8cbe-a3ccd50a8610 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.366577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343b65c-2b64-4c6a-8cbe-a3ccd50a8610 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.367562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343b65c-2b64-4c6a-8cbe-a3ccd50a8610 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.369660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 210/420] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:55.378209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.378788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.379351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.383508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:55.384183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.384469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.384744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.401068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:55.403117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:55.462671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:55.464047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:55.503589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 211/421] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:55.539303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:55.625243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 211/422] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:55.631494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:55.662778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:55.706252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cab5f4-0f4c-41e9-9f2b-5988944b85d9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:55.725295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:55.758641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:55.759708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.760177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.760608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.779554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:55.788404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:55.790063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:55.791065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:55.799131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 212/423] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:55.812730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:55.828609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924b46-52ca-4aec-8ad0-9a8f023dbd4f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:55.864760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:55.865619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:55.865898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:55.866169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:55.867946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:55.869427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:55.875631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 212/424] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:55 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:55.876834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:55.982276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.003539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765bf41-4fa3-4605-84d4-6eded9b37403 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.004070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1e6f-2e4d-4fe1-9a1a-f1cf2ce8928f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.042683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.043536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.043812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.044112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.045302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:56.046734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:56.053145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 213/425] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:55 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:56.054392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.079292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.079969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.080273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.080599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.081449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:56.081892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:56.083266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:56.107435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 213/426] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:56.121151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.159470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfaac6d-f40e-4d3b-bc73-076564d83c13 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.196142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.196858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.197148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.197431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.198785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:56.199160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:56.200388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.201012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf0532-3281-4c21-af0f-ca9e088020c5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:56.211128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 214/427] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:56.212477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4a3f-81b2-438b-a582-ba5fd84ded72 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.212767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4a3f-81b2-438b-a582-ba5fd84ded72 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.213048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4a3f-81b2-438b-a582-ba5fd84ded72 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.214702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 215/428] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:56.220602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.221048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.221333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.243419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:56.245299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:56.272432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.330961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2eee-706f-4e47-ba3b-030f69d5ada3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.368230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:56.392222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.392911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.393170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.393452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.396092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.504492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:56.505973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:56.534413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b46ab8-a20b-45c2-8ebd-a1f48342581a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.557716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.575671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.576518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.576805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.577085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.588707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:56.596572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:56.597722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:56.598501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 217/430] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:45:56.603597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.608796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.649218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 214/431] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:56.657399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.718375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc25bbf-90f4-4d11-8c3a-3dd7f2c31eca None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.756344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.757030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.757660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.758019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.759346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:56.759731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:56.761767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:56.775540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 218/432] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:56.779800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912cf19-b8e1-4136-bfe3-ecf2271653e3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.780616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.827799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.828802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.829153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.829516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] PATH_INFO: `/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.830792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] RBAC: Authorizing `identity:get_project(project_id=ce9c907e05824b55afd1b5fdd114a1a5)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:56.832385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:56.839128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 215/433] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/projects/ce9c907e05824b55afd1b5fdd114a1a5 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:56.841705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:56.856915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.872699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:56.922454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3168211-02f7-4b47-9616-db29dbdf5e09 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:56.968492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:56.969303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:56.969735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:56.970018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:56.971709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1504-1904-4a13-af6f-821a7a7d90a7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.017509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.018329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.018613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.018950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.020464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:57.022713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:57.028009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 216/434] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:57.033759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.053452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:57.055934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:57.128368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:57.152149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:57.153653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7dc8b9-873b-4a59-8095-3b010383c29b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.188587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.189250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.189804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.190740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:57.191051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:57.192697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:57.195554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 219/435] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:45:57.202996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.204954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 217/436] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=ce9c907e05824b55afd1b5fdd114a1a5&role.id=423552284f2a4983b5eef8fc699e5515 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:57.314480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f217f5b-322d-48f4-9c72-6a40c6c9a57e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.353642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41e58e-3773-467d-86c9-5d34d7feed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.354893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41e58e-3773-467d-86c9-5d34d7feed41 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.355392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41e58e-3773-467d-86c9-5d34d7feed41 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.355867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41e58e-3773-467d-86c9-5d34d7feed41 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.358145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41e58e-3773-467d-86c9-5d34d7feed41 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:57.359786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41e58e-3773-467d-86c9-5d34d7feed41 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:57.361758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 220/437] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:57.367336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.446432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16f63-481b-4041-bbb1-96d99de9b815 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.447431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16f63-481b-4041-bbb1-96d99de9b815 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.447913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc16f63-481b-4041-bbb1-96d99de9b815 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.449539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 221/438] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:57.457357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390791b-d78b-4d2f-af8e-841f2177ab5e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.457642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390791b-d78b-4d2f-af8e-841f2177ab5e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.457916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390791b-d78b-4d2f-af8e-841f2177ab5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.478528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbac91-e4a3-4eb8-a439-d1b3c719cb87 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.481760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f390791b-d78b-4d2f-af8e-841f2177ab5e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:57.482936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f390791b-d78b-4d2f-af8e-841f2177ab5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:57.515653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.516721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.517004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.517399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:57.518389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.519595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:57.521277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:57.524331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 218/439] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:57.529157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.542607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:57.573105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 222/440] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:45:57.574219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c0808-5ba2-4c42-a7c8-8082f0015149 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.574506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c0808-5ba2-4c42-a7c8-8082f0015149 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.574784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c0808-5ba2-4c42-a7c8-8082f0015149 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.576084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 223/441] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:45:57.581179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.581465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.581745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.603304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:45:57.604861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:45:57.666183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e238ce3-9ae2-4e99-a04b-47961827abe7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.686240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 224/442] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:45:57.687322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.708015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.708930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.709361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.709777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.711246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=423552284f2a4983b5eef8fc699e5515, scope.project.id=279158339e1e4648ac9028e333ebd692) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:57.711701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:57.713346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:57.720359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 219/443] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=423552284f2a4983b5eef8fc699e5515 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:45:57.721169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.819790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:57.827571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:57.836283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e78f4a-4070-4f6d-988f-48c8bc2831d8 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.863899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8fe9-c4bb-4167-bfe0-b8878f6a442c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:57.880017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.880684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.881284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.881566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.896169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:57.903728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:57.904679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:57.904969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:57.905247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:57.906037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:57.907105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:45:57.908226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 225/444] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:57.912572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:57.916978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:45:57.924749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:45:57.925626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:45:57.926676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 220/445] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:45:57.931814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.032176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13362ea2-e2f5-4ed7-9944-603695528400 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.052713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a5156-8c5d-4578-84ff-53e49625d8bb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.073719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.073719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.073993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.074141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.074898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:58.075212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.076646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.091749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 226/446] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.093009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.095606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.102738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.103409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.103690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.103962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.104746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:58.105054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.106436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.114929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 221/447] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.120383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.121769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.201961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad7a56-aa5a-4829-978c-5e2761e713e4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.217072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecd018-f0c5-4b5b-a4e7-198c6b2231c1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.234454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.235148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.235428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.235724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.249782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.250428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.250711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.250989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.301520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.302683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.309848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.318113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.319203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.319545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.398591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 227/448] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:45:58.404071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.416406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 222/449] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:45:58.421912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.505140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060abd8f-3f65-446e-ab6b-2ec1a9ee18f0 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.511956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.518850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c657f3-1a3a-4a1e-a3a4-5e5eaf81dae4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.521986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.539551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.540431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.540715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.540989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] PATH_INFO: `/v3/projects/279158339e1e4648ac9028e333ebd692` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.542179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] RBAC: Authorizing `identity:get_project(project_id=279158339e1e4648ac9028e333ebd692)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.543604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.545325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 228/450] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/projects/279158339e1e4648ac9028e333ebd692 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.550603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.552085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.552936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.553214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.553487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] PATH_INFO: `/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.555177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] RBAC: Authorizing `identity:get_project(project_id=7f168e0b349b4ecc9d941ccf0785ad5d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.556635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.558307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 223/451] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/projects/7f168e0b349b4ecc9d941ccf0785ad5d => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.563433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.648319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26469343-0e26-45f2-92a7-52657da55500 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.657664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ee542-41f9-4b95-adfc-aaa7416f0625 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.681615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.682489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.682775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.683053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] PATH_INFO: `/v3/groups/537d642dc4734431b8e8bb32f81c7a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.684268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] RBAC: Authorizing `identity:get_group(group_id=537d642dc4734431b8e8bb32f81c7a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.685708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.687551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 229/452] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/groups/537d642dc4734431b8e8bb32f81c7a30 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.690751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.691617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.691895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.692215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] PATH_INFO: `/v3/groups/57303fc133424ce49e41286ac1e91ab0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.692955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.693392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] RBAC: Authorizing `identity:get_group(group_id=57303fc133424ce49e41286ac1e91ab0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.694823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.696485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 224/453] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/groups/57303fc133424ce49e41286ac1e91ab0 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.701862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:45:58.731287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.745814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:45:58.791848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4b81f-765c-4e9e-b8ec-efcb391ecc34 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.799326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4150-5e91-4f2c-86a2-8539f48b67ad None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:45:58.826631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.827310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.827592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.827927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.828785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] RBAC: Adding query filter params (group.id=537d642dc4734431b8e8bb32f81c7a30, role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=279158339e1e4648ac9028e333ebd692) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:58.829096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.830532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f816c-3477-47fc-a4b7-d29a619b5f09 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.832690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:45:58.833327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:45:58.833607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:45:58.833878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:45:58.834701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] RBAC: Adding query filter params (group.id=57303fc133424ce49e41286ac1e91ab0, role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=7f168e0b349b4ecc9d941ccf0785ad5d) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:45:58.835009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:45:58.836279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 230/454] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/role_assignments?group.id=537d642dc4734431b8e8bb32f81c7a30&scope.project.id=279158339e1e4648ac9028e333ebd692&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:45:58.840255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b4663-7bdf-4ee5-a08b-5f78361ff597 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:45:58.847018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 225/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Jun 21 09:45:58 2022] GET /identity/v3/role_assignments?group.id=57303fc133424ce49e41286ac1e91ab0&scope.project.id=7f168e0b349b4ecc9d941ccf0785ad5d&role.id=7adf0608488a4c0780e809cd640a911c => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:01.451960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9d48-236b-483b-8b78-6e88ec72896b None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:01.452952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9d48-236b-483b-8b78-6e88ec72896b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:01.453451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9d48-236b-483b-8b78-6e88ec72896b None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:01.455269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 231/456] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:01.461046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb60a3-84c3-4bb4-a5c8-a189d6596039 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:01.461939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb60a3-84c3-4bb4-a5c8-a189d6596039 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:01.462412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb60a3-84c3-4bb4-a5c8-a189d6596039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:01.486067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5acb60a3-84c3-4bb4-a5c8-a189d6596039 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:01.487695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5acb60a3-84c3-4bb4-a5c8-a189d6596039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:01.583515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 226/457] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:01.613156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca9d48-236b-483b-8b78-6e88ec72896b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:01.719025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ab0bf-7d8a-40ba-9394-c017f75713bf None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:01.719624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ab0bf-7d8a-40ba-9394-c017f75713bf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:01.720135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ab0bf-7d8a-40ba-9394-c017f75713bf None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:01.721733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 227/458] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:01.728728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:01.729030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:01.729300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:01.750987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:01.753333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:01.769560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca9d48-236b-483b-8b78-6e88ec72896b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:01.785723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:01.796330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:01.814555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:01.815834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:01.816341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:01.816891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:01.829664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:01.831416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:01.852988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:01.853941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:01.854794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:01.854794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:01.854794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:01.854794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:01.857899 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 232/459] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:01.864405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:01.915436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 228/460] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:01.961399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.035529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe5af8-98b9-47d0-8969-a6a03ada6191 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.072788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.073452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.073734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.074015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.074738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:02.075053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.076475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563f7cc-8f1b-42bb-a853-d29d6951ece1 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.080714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f799f59-7e31-4ec8-af56-42189e54b386 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.090369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 233/461] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:02.093820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47996-a4e8-4dc9-96a9-ef5877f11df6 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.094316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47996-a4e8-4dc9-96a9-ef5877f11df6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.095150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f47996-a4e8-4dc9-96a9-ef5877f11df6 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.097678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 234/462] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:02.099483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828b49-d481-4f37-b7be-fff1ecb7f3f8 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.100241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828b49-d481-4f37-b7be-fff1ecb7f3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.100717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91828b49-d481-4f37-b7be-fff1ecb7f3f8 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.107835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 235/463] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:02.108523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91828b49-d481-4f37-b7be-fff1ecb7f3f8 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.122737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.123633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.124017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.124379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.136082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.137543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.138014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-308bb5b2-3276-49c4-9550-cc401f458fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:02.158439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:02.159298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:02.160530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:02.160530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:02.160530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:02.160530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:02.160927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 229/464] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:02.161978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c7633-27d6-4021-aba9-3f695c04808b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.162273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c7633-27d6-4021-aba9-3f695c04808b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.162549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c7633-27d6-4021-aba9-3f695c04808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.175016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:02.180914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-905c7633-27d6-4021-aba9-3f695c04808b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:02.182083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-905c7633-27d6-4021-aba9-3f695c04808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:02.225903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91828b49-d481-4f37-b7be-fff1ecb7f3f8 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.253088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 230/465] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:02.260633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.261289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.261570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.261844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.262536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.263951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.266386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.266670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.266942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.284212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:02.285462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:02.290433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 236/466] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:46:02 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:02.292979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.372006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 231/467] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:02.372006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.446435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:02.467944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:02.469855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe70df7-7c29-4724-88de-7c481e0e6f7b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.514184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb471-1682-480c-9388-dca198469a0b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.515159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.516145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.516635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.517173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.517922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:02.518235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.519615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.533071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 237/468] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:02.534153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.553575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.554417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.554789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.555133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.565896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.567467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:02.586392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:02.587278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:02.588135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:02.588135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:02.588135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:02.588135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:02.588135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 232/469] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:02.589179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.650644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc33cf-971e-405d-8605-0567a0b11507 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.693696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.694526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.695349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.695628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.700562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3adc1-0bce-46cd-b920-7f7922f5e51f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.706475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.708076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.711697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:02.730556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:02.731536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:02.732797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:02.732797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:02.732797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:02.732797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:02.739151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:02.739589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 238/470] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:02.740697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.740946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.741631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.742430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.742704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.743417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.744878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.770526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 233/471] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:46:02 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:02.771873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.864558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f754b-4bbe-41f6-a030-fc61e6c7b083 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.905968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.907103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.907685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.908263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.909230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:02.909746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.910592 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff490f-4cb7-4d30-bde7-e4a6afe9fb16 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:02.911682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254a9d9-2a09-4723-905d-5154f2fa6ac2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.925136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 239/472] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:02.926841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18c29d-d642-446d-8ea2-e73c27b4938e None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.927433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18c29d-d642-446d-8ea2-e73c27b4938e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.927906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18c29d-d642-446d-8ea2-e73c27b4938e None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.930044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 240/473] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:02.931012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18c29d-d642-446d-8ea2-e73c27b4938e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:02.961007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:02.962081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.962631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.963115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:02.963843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:02.964295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:02.965917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7be23f-efc5-4772-87c5-bdf12bf10041 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:02.981548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 234/474] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:02.982148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:02.982489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:02.982770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:03.001416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:03.002147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:03.013146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:03.038702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:03.069553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18c29d-d642-446d-8ea2-e73c27b4938e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:03.084444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 235/475] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:03.085395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:03.124939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:03.125709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:03.126159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:03.126502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:03.127281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:03.128889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:03.155482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 241/476] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:46:02 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:03.156559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:03.200783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249acb54-075a-48f1-8b41-b36cec1729d6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:03.238362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:03.239055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:03.239347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:03.239624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:03.248631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:03.250161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:03.275004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8550b-2dca-46be-9790-78e1076b53ee None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:03.287054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 236/477] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:46:03 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:03.301776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:03.336823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:03.337518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:03.337802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:03.338082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:03.338912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:03.340401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:03.353569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.sql.core [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 09:46:03.353569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 09:46:03.353569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [parameters: {'id': '729ed68453d64aabae0e6c491773e6d9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 09:46:03.353569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80068) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application conn.query(q) Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result.read() Jun 21 09:46:03.370657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 09:46:03.371624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application next(self.gen) Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application yield resource Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application next(self.gen) Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise self.value Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application session.commit() Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 09:46:03.372742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.session.flush() Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application compat.raise_( Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 09:46:03.373601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 09:46:03.374481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application conn.query(q) Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result.read() Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 09:46:03.375325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [parameters: {'id': '729ed68453d64aabae0e6c491773e6d9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:03.377417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 09:46:03.379277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:03.380991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 242/478] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 09:46:03 2022] POST /identity/v3/roles => generated 144 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:03.381162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:03.411146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:03.502148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31758ba7-aa67-47fd-805b-fbaed06f60e2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:03.539390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16d486-e502-4606-bf73-4211e6fa4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:03.540237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d486-e502-4606-bf73-4211e6fa4b0e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:03.540525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d486-e502-4606-bf73-4211e6fa4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:03.540800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d486-e502-4606-bf73-4211e6fa4b0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:03.552383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16d486-e502-4606-bf73-4211e6fa4b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-fd16d486-e502-4606-bf73-4211e6fa4b0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:03.560696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:03.561571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:03.562360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 237/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:03.567959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:03.688501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365853fc-2b44-42a2-9c23-57b69baebc3e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:03.725127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:03.725789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:03.726751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:03.727034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:03.727787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:03.728141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:03.729523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af001c4-d833-492c-a5ef-3d949c91215e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:03.738222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 243/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:04.636217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f1f7b-addf-4b18-a462-19e693ccc367 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:04.636725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f1f7b-addf-4b18-a462-19e693ccc367 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:04.636828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f1f7b-addf-4b18-a462-19e693ccc367 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:04.638410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 238/481] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:04.643599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:04.644022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:04.644203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:04.665082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:04.666273 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:04.707208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:04.776775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 244/482] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:04.812844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f1f7b-addf-4b18-a462-19e693ccc367 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:04.922055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:04.942906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f1f7b-addf-4b18-a462-19e693ccc367 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:04.976564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:04.977372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:04.977658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:04.977935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:04.988121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:04.996433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:04.997310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:04.998495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 239/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:05.003589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.120316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7322d-dd79-47a8-b8d8-c787887ea837 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:05.154886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:05.155602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.155890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.156212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.156956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:05.157265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:05.158632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75003fba-371b-4a2c-b6ac-ebff5b49442a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:05.167622 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 245/484] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:05.173089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.296106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fdef0-8d49-4302-b4ba-fc48690e5114 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:05.318902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941769-ffa2-41bb-8e0f-067727a1bba8 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.319213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941769-ffa2-41bb-8e0f-067727a1bba8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.319512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941769-ffa2-41bb-8e0f-067727a1bba8 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.321260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 246/485] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:05.326287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.326676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.327053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.336609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:05.338473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.338907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.339328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.351782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:05.353571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:05.356308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:05.357142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:05.358349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:05.373037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:05.373928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:05.374746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:05.374746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:05.374746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:05.374746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:05.374746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 240/486] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:05.384005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.415000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:05.495309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 247/487] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:05.544291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.555034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e3d77-0a21-46f7-af24-77e5b3c8dccc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:05.607784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:05.608473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.608760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.612002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.612808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:05.613133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:05.614506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:05.648867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 241/488] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:05.665366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.717148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c49f-b75c-4288-bec1-c25c3ae9cb81 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:05.754326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:05.755472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.755957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.756473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.768274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:05.771934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:05.778733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:05.779634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:05.780450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:05.783143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 248/489] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:05.788901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.813673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:05.884277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03f74d-462e-4c4f-b962-b627adc6894b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:05.903447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c318b83-3e81-4dd4-8ac1-93285623eb17 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:05.925802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:05.927341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.928044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.928557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.937762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:05.939314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:05.944382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:05.945774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.946251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.946667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.947556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:05.948043 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:05.949540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dba4e0-67de-4fbe-bf45-57fcdf5cc627 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-050969e7-83b2-4578-ab64-e122b65b4098 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:05.957477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:05.958401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:05.959292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:05.959788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 249/490] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:05.959863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 242/491] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:05.960487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff438-f688-4066-890f-93c33b164ef9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.960649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff438-f688-4066-890f-93c33b164ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.961761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff438-f688-4066-890f-93c33b164ef9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.962993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 243/492] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:05.963871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eff438-f688-4066-890f-93c33b164ef9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:05.964092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6586-b689-4ae4-a2bb-4ee4dead2e5f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.964393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6586-b689-4ae4-a2bb-4ee4dead2e5f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.964675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab6586-b689-4ae4-a2bb-4ee4dead2e5f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.966294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 250/493] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:05.973493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5fe5-f09e-4641-b302-71a269b1239a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:05.973781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5fe5-f09e-4641-b302-71a269b1239a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:05.974057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc5fe5-f09e-4641-b302-71a269b1239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:05.993380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d1cc5fe5-f09e-4641-b302-71a269b1239a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:05.994825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d1cc5fe5-f09e-4641-b302-71a269b1239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:06.069132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eff438-f688-4066-890f-93c33b164ef9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.072559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 251/494] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:06.073633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.073921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.074193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.094773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.099768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:06.100914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:06.109633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.118574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.119372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.119652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.119944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.120804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:06.121111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.122551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.159702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 244/495] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:46:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:06.160964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.179837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 252/496] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:06.180972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.286431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c659360-8c52-48ef-ba1f-f23b90923f8e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.286859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83961b6d-5200-4637-91fa-8c7097986a65 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.324574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037c273-1258-4730-8b02-f860256c355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.324778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.325282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037c273-1258-4730-8b02-f860256c355d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.325473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.325570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037c273-1258-4730-8b02-f860256c355d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.325820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037c273-1258-4730-8b02-f860256c355d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.325922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.326128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.336582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037c273-1258-4730-8b02-f860256c355d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:06.337518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.338959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f037c273-1258-4730-8b02-f860256c355d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:06.344448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:06.345296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:06.346115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 253/497] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:06.347482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037c273-1258-4730-8b02-f860256c355d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.352986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:06.360145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:06.361002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:06.361829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:06.361829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:06.361829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:06.361829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:06.361829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 245/498] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:06.362580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.388167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.461115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037c273-1258-4730-8b02-f860256c355d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.473696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c647fd-9d3b-4d43-8125-5f903bf91206 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.496943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.497591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.497870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.498145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.509682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.510477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.510761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.511040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.521810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:06.530126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:06.531005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:06.531794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 246/499] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:06.533193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.576858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.578233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.580247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.623349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.642215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d2d689-50ae-40bc-9482-7cfad36e313d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.674692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.675354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.675638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.675916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.676701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:06.677012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.678394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.680334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 254/500] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:06.681166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.692025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 247/501] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:06.692025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.783743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a1469-f044-483c-9ad3-e276b189d435 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.785402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.788405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9916f-9f7b-44b6-b9e5-5e0bfa1500ba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.821096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.821757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.822049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.822311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.823034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:06.823339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.824731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f2ae6-ca40-4ff0-92d7-523181c4d6ce None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.830377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.830983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.831272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.831550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.832330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:06.832655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.834016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.836107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 255/502] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:06.837316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03a4f-89a1-4c2b-9da2-e1a8638a2c76 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.837601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03a4f-89a1-4c2b-9da2-e1a8638a2c76 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.837882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03a4f-89a1-4c2b-9da2-e1a8638a2c76 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.839096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 256/503] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:06.839781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03a4f-89a1-4c2b-9da2-e1a8638a2c76 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.849632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 248/504] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:06.850322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:06.859648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:06.941608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03a4f-89a1-4c2b-9da2-e1a8638a2c76 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.949675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f7fa3-624b-47c9-b222-ac485429cb02 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:06.973929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.974716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.975003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.975282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.982620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:06.983394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:06.983678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:06.983956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:06.986193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.987657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:06.994969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:06.996809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:07.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.005392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.006264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:07.006264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:07.006264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.006264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:07.006264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 257/505] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.006847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ba2e1203-93a1-47f5-a1d6-2d12bd4216fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:07.013845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.014873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 249/506] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.020199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.025457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.034577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:07.035788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:07.089412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.108517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 250/507] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:07.109421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.123710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5b7b1-474d-4e87-b842-1864f8b44c53 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.158084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.158873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.159161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.159438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.167499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.168972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:07.184638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.185555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:07.186486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 258/508] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.187046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.211927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1815a-4fe8-4d8d-8dfc-b3bb544051f8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.245594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.246372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.246654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.246927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.256607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.258080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.259716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:07.276303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.277219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.282777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:07.282777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:07.282777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.282777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:07.282777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 251/509] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.282777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.285632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d23c2-fcc5-4229-9565-59483d93ec7d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.319596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.320305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.320583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.320861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.321603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:07.321909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.323286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.328045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.335088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 259/510] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:07.336621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.389238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612b02e-2d71-4a9d-8cab-18b4a3421d97 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.425902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.426554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.426834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.427117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.427832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:07.428168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.429560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.433124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb5e6-0ae9-4e42-95b3-50b75f235cfc None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.440904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 252/511] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:07.441719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.470090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.470876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.471163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.471437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.473616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.486748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.488241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:07.505500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.506352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.507202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:07.507202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:07.507202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:07.507202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:07.507202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 260/512] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.507472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.541786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.544597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b361-2af0-4e71-98ff-bbcf1a569594 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.578090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.578760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.579046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.579323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.580194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:07.580505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.581921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.599811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 253/513] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:07.600646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.610657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f97fb-fb5a-488b-8437-9e44072c5041 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.643727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.644331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.644612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.644880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.645589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:07.645891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.647341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.658902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 261/514] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:07.659815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.700564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac5311-4d1d-4555-b2c2-00464def1e99 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.705966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.736104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.736893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.737177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.737453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.744169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.745615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:07.760444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.761460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:07.762363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:07.762764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f7716-efbd-453a-a952-b5eb6b1efe11 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.764561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 254/515] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.765544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.785060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.794946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.795733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.796030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.796307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.803825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.805289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:07.821020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:07.822112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 262/516] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:07.823513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.871202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65850157-e751-40c6-b092-55f8996571c8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.905575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.906204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.906707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.907075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.907809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:07.908158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:07.909541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:07.920981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 255/517] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:07.921220 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45503f-efc3-4fb4-ba11-347408dd0170 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:07.921762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:07.931605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:07.959226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:07.959868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:07.960179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:07.961030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:07.999376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.021332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc24ff-4e82-4f64-bd66-7e340c5b590e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.027749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.029245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.055772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.056596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.056880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.057159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.064126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.065577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:08.080310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:08.081356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:08.082400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 256/518] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:08.084025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.129088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 263/519] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:08.129928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.138396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.187417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2a72-bc2e-405d-b690-f278aa9cec1b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.220944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.221594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.221877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.222399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.223177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:08.223487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.224938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.226423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a38f-5e90-4f5f-be96-56c036684373 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.235548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.243835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 257/520] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:08.244731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.264480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.265140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.265421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.265697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.266540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:08.266844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.268508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.303563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 264/521] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:08.304930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.345240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880ea6-b5bd-4d69-988b-63a57fab09cf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.364476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.378588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.379246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.379531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.379808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.380551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.381986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.401983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 258/522] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:46:08 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:08.402775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.403294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af1f9d-4663-44e4-9af3-9e1a7584a13d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.445605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.446196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.446600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.446869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.447844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:08.448186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.449844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.474679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 265/523] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:08.474679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.482625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.533070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3557c8-63f0-4090-9c13-889f16c587ca None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.573669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.574468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.574751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.575027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.585700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.587155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.590000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691475d5-c334-4717-8a99-b8707bc74098 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:08.608255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:08.609299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:08.610147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:08.610147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:08.610147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:08.610147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:08.610147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 259/524] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:08.610422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.622069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.634245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.634981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.635333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.635676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.636632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=947e9ae8d1a44654b3c294b849912707) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:08.636947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.638389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.644525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 266/525] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/role_assignments?user.id=947e9ae8d1a44654b3c294b849912707&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:08.645379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:08.747850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae22331-00ad-47e4-954c-8cb96bd10a35 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.761130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.792636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414d6b-f647-4d0e-b871-1443ca910b2f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:08.797841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.798502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.799551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.799830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.839692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:08.840377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:08.840916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:08.841204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:08.884675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.886137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:08.914814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:08.937442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:08.939023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.002153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 260/526] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:09.003056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.012386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.068883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 267/527] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:09.069069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.132191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55777c3-1a0a-42ae-bc04-925e3f71c1eb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.177908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.178575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.178858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.179170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.180029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.180831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:09.181111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.182729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.199853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517153df-793c-4e42-9df7-ce35336b662d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.203190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 261/528] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:09.204282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.240392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.241180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.241461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.241777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.252403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.253831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:09.272557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:09.273496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:09.274340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:09.274340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:09.274340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:09.274340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:09.278358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 268/529] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:09.279199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.288406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.336212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ae661-8420-430d-ba48-b0950050ce2e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.372314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.373182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.373471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.373749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.388353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.390494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.407627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1de881-1ba6-4848-aa40-810119a75c23 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:09.413522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:09.414335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:09.415158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:09.415158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:09.415158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:09.415158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:09.419822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 262/530] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:09.420717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.453151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74743b-f189-44e2-a022-828da054181d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.454905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74743b-f189-44e2-a022-828da054181d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.455384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74743b-f189-44e2-a022-828da054181d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.456138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74743b-f189-44e2-a022-828da054181d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.465203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74743b-f189-44e2-a022-828da054181d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.467161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74743b-f189-44e2-a022-828da054181d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.470239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-4b74743b-f189-44e2-a022-828da054181d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:09.489797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:09.490673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:09.491502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:09.498269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 269/531] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:09.498269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74743b-f189-44e2-a022-828da054181d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.566046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053f408-7313-4a11-b861-77fa6a91453c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.591117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.610436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.611107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.611390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.611667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.612433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:09.612745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.614126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.618100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74743b-f189-44e2-a022-828da054181d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.631450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 263/532] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:09.633043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.662083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.663307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.664173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.664369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.665098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:09.665412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.666814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.683057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 270/533] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:09.683922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.744572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.753064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736614-4646-4b3e-baad-ac5543d1786d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.784915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59506e04-687e-47b9-bfa2-d208c8b0b441 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.791234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.792328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.792969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.793445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.794476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:09.794989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.796762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.815433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 264/534] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:09.817188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.824580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.825381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.825756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.826086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.833757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.835232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:09.851321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:09.852642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 271/535] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:09.853468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:09.864768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:09.931782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d1924-e70d-4f1e-b301-f4156e7a693a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.966249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc77063-263e-49c7-8a0b-9cca23628707 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:09.970268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:09.971058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:09.971387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:09.971666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:09.979389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:09.980861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:09.997112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:09.998148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:09.999222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:10.000898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:10.002624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 265/536] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:10.003659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:10.028077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:10.028737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.029068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.029355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.030708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=bb8e8cab0c654fc39a73caa7c718ae56) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:10.031024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:10.033114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:10.041514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 272/537] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:09 2022] GET /identity/v3/role_assignments?user.id=bb8e8cab0c654fc39a73caa7c718ae56&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:10.042606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:10.194766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:10.201641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda755-81b0-41bb-bf52-8f1f1f79e819 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:10.215683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c9052-df61-4db3-9d2e-dbc9b4d22285 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:10.253609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:10.254730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.255280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.255796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.257596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:10.258186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:10.259029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410511-91da-4913-a33c-811b52160656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:10.259754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410511-91da-4913-a33c-811b52160656 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.260138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410511-91da-4913-a33c-811b52160656 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.260444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:10.260559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48410511-91da-4913-a33c-811b52160656 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.261340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410511-91da-4913-a33c-811b52160656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:10.261717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410511-91da-4913-a33c-811b52160656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:10.263448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48410511-91da-4913-a33c-811b52160656 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:10.284993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 273/538] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:10.286970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 266/539] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:10.292151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410511-91da-4913-a33c-811b52160656 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:10.306357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:10.344069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:10.408102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48410511-91da-4913-a33c-811b52160656 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:10.448404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:10.449294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.449650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.450020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.450932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=8c7daa59378346bb9466961ea4c7c447) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:10.451325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:10.454607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c695a3f-5dac-423c-985c-2b1a38786bc4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:10.459559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 274/540] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:10 2022] GET /identity/v3/role_assignments?user.id=8c7daa59378346bb9466961ea4c7c447&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:10.540958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7673cb-1bed-432f-a8bb-6d9df4205923 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:10.594582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:10.595253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.595534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.595810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.596676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=1ea057364d054564b4c44f7a5d60f94b) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:10.597242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:10.599641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cedd8-8d44-4ab6-a412-fccc168d271f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.599928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cedd8-8d44-4ab6-a412-fccc168d271f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.600235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cedd8-8d44-4ab6-a412-fccc168d271f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.602371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 275/541] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:10.602947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:10.607369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7d1e-476b-4f9c-8f1b-758a422675e5 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.607754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7d1e-476b-4f9c-8f1b-758a422675e5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.611151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7d1e-476b-4f9c-8f1b-758a422675e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.617281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 267/542] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:10 2022] GET /identity/v3/role_assignments?user.id=1ea057364d054564b4c44f7a5d60f94b&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:10.627165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a33e7d1e-476b-4f9c-8f1b-758a422675e5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:10.628643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a33e7d1e-476b-4f9c-8f1b-758a422675e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:10.740955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 276/543] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:10.764864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:10.806529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:10.903023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff816c4a-719c-431c-8a84-1694dc18c49e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:10.942737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce90213-6881-4474-adc4-7a9a37711a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:10.943888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90213-6881-4474-adc4-7a9a37711a4e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.944457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90213-6881-4474-adc4-7a9a37711a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.945474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90213-6881-4474-adc4-7a9a37711a4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.956245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce90213-6881-4474-adc4-7a9a37711a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:10.963644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c190-fc62-45ec-b71c-942d52fd6da1 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.964113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c190-fc62-45ec-b71c-942d52fd6da1 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.964281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26c190-fc62-45ec-b71c-942d52fd6da1 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6ce90213-6881-4474-adc4-7a9a37711a4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:10.965751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:10.966629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:10.967406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:10.968029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 277/544] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:10.970084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 268/545] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:10.975889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26c190-fc62-45ec-b71c-942d52fd6da1 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:10.977180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:10.977472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:10.977754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:10.998502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:10.999788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:11.042362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:11.114727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 269/546] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:46:11.152501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26c190-fc62-45ec-b71c-942d52fd6da1 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:11.156484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.176356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:11.229942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:11.230606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:11.230882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:11.231155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:11.231962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:11.232287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:11.233690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:11.247566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 278/547] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:11.256650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.343207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0b1a6-778d-4ea9-8fab-e730ade0925a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:11.392632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:11.393482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:11.393763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:11.394033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:11.412917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:11.421724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:11.422590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:11.423360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 270/548] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:11.433217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.440832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:11.446259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8328b9c-b5c0-471d-b938-7c4801fd5e39 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:11.495327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:11.496484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:11.497041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:11.497515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:11.517962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:11.519755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:11.524427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:11.560001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55d3ed-a66c-49fd-a98e-a2cc0de852ac None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:11.561484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:11.562292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:11.563841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:11.563841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:11.563841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:11.563841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:11.566040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 279/549] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:11.571390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.596666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:11.597584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:11.597865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:11.598137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:11.599367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:11.599674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:11.601600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:11.615455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 271/550] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:11.624964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.750285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac736d0-ca0b-4194-a317-259aa345a592 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:11.799695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b99a2-5e29-456c-b8f7-e34e90da70a3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:11.822202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:11.823198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:11.823873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:11.825683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:11.826668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:11.828069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:11.831269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:11.854153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 280/551] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:11.859354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.861422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:11.864754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:11.865253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:11.865744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:11.872303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:11.885246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:11.886723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:11.888261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:11.925787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:11.926813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:11.927779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:11.927779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:11.927779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:11.927779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:11.927779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 272/552] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:11.932992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:11.970169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3515c-d7ed-4b28-8326-a35b90248364 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.005430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.006546 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.007031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.008143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.015931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.017639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:12.032791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:12.033692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:12.034596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:12.037228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 281/553] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:12.052193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.092169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70290e6-63b2-4193-b766-8c5dfdf86b06 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.126937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.127632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.127917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.128251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.128973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:12.129279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.136018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.144035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 273/554] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:12.156007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.202538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.208866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.256438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668107-bfb2-4752-b3f9-e858f75ef526 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.277913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d145a-2b82-4c90-97f1-1ee01720dc4f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.291799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.292512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.292795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.293074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.293918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:12.294227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.295662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb6e01-e12c-41b8-aa34-c2fc6d29496b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.314519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 282/555] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:12.315892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69172f-0ecb-43be-bc99-d2524984049a None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.316230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69172f-0ecb-43be-bc99-d2524984049a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.316505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69172f-0ecb-43be-bc99-d2524984049a None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.322261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 283/556] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:12.323254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69172f-0ecb-43be-bc99-d2524984049a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.326793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.328580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.328915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.329198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.339074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.341163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0c6b1792-8538-4669-a941-7de24a958dba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:12.363808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:12.365017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:12.366439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 274/557] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:12.367704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.367704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.367704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.388151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:12.389841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:12.436662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69172f-0ecb-43be-bc99-d2524984049a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.470635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.471437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.471822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.472492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.477565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 275/558] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:12.478421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.488371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.517593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.567874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.569441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.608483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fca27-f7d9-476d-824a-510f4445656a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.645134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.646128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.646557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.646974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.648600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:12.649051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.650729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.670158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 276/559] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:12.671377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.680019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 284/560] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:12.680179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.707840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.778822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.784959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c79e-f30f-4a1b-97a5-7dc45f904f70 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.786145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63077c-be61-49c9-9b27-bf328d204c22 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.822889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.823607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.823886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.824185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.825325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:12.826193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.826485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.826764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.835166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:12.837190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:12.838163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:12.846143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:12.847480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:12.848374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 277/561] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:12.849328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f2bdd69a-3bbd-4791-8fdd-8bff8e926698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:12.859969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:12.860852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:12.861726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:12.861726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:12.861726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:12.861726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:12.861726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 285/562] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:12.862793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d75c-6ddd-4c14-8ff0-d9e49f940b4e None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:12.862899 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d75c-6ddd-4c14-8ff0-d9e49f940b4e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:12.863098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d75c-6ddd-4c14-8ff0-d9e49f940b4e None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:12.864506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 286/563] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:12.865073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444d75c-6ddd-4c14-8ff0-d9e49f940b4e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:12.961240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:12.964153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9e9f9-40b9-4229-8d1a-b986a624e70e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.983718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444d75c-6ddd-4c14-8ff0-d9e49f940b4e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:12.999478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.000297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.000576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.000848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.013181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.014637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.020466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.021743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.022214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.023633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.024610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.025120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.026826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47950b94-ba29-493a-b259-63a0c26a741b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:13.032268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:13.033158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:13.034036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:13.034036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:13.034036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:13.034036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:13.034036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 278/564] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:13.034308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.041166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 287/565] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.042731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.043192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.043648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.044841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.062061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:13.063456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:13.140487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 288/566] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:13.141235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.153896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa84b3f-f6bc-4010-a9bd-7e1e2e1ca689 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.195203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.196244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.196770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.197262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.198456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.198831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.200212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.217803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 279/567] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.217803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.219768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.254822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad1e86-268f-4640-9814-6914d9bf9fd9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.286595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.291617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.292306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.292614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.292891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.293611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.293940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.295299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.307091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 289/568] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.307862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.324848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a87ea3-1859-46ff-b9a3-bf88f350647a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.357950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.358693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.358975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.359248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.369622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.371041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:13.388770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:13.389649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:13.390520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:13.390520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:13.390520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:13.390520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:13.390520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 280/569] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:13.390797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.403820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3ebe5-4f23-44fb-ba1d-b58ebc9ac5a8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.431992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.437533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e824a-63f0-4534-8b6b-1edad65bcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.438320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e824a-63f0-4534-8b6b-1edad65bcc6e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.438605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e824a-63f0-4534-8b6b-1edad65bcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.438887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e824a-63f0-4534-8b6b-1edad65bcc6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.449572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e824a-63f0-4534-8b6b-1edad65bcc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f22e824a-63f0-4534-8b6b-1edad65bcc6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:13.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:13.458191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:13.459045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 290/570] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:13.459734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ad93-79de-49f1-99e0-91216c2763d0 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.459990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ad93-79de-49f1-99e0-91216c2763d0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.460191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ad93-79de-49f1-99e0-91216c2763d0 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.461796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 291/571] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:13.462398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ad93-79de-49f1-99e0-91216c2763d0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.495799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3830326-253c-445f-a708-fe154b1f860d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.513337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.533015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.533808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.534094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.534373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.544049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.545550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:13.559635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:13.560638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:13.561503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:13.562143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ad93-79de-49f1-99e0-91216c2763d0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.564134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 281/572] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:13.564935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.594833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.595607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.595885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.596176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.603182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.604647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:13.620378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:13.621366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 292/573] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:13.622240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.665001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8d22c-a35a-4eb9-b784-f894f17ed5be None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.673802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.698316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.698968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.699245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.699520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.700254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.700559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.701913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dec8aa-c1ee-47a1-b325-4ef13d004569 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.713637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 282/574] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.714890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.715176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.715450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.720621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a97e1-9f53-4e22-8efb-1d24aee6f888 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.731525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:13.732728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:13.754907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.755567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.755849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.756157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.756905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.757217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.758585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.761065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.766418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 293/575] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.767195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.802312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 283/576] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:13.803135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.879788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcda56-cd16-418d-b06e-7b42e6f4a2f3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.893144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:13.903054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f938-c148-459b-ad6f-1e5bccb691d4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:13.914242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.914891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.915176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.915453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.916274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.916589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.918015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.930290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 294/577] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.931078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.937611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:13.938264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:13.938543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:13.938817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:13.939595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:13.939897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:13.941350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:13.952553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 284/578] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:13.953319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:13.980776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.035551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108610f-7996-47c7-87ab-3fe935f83632 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.052906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a80e-cd3f-476c-ad6d-1b70893455f4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.068631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.069412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.069720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.069998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.076846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.078277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.084775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.086077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.086362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.086642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:14.093059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:14.094113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:14.095070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 295/579] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:14.095646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.105859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.107668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:14.124904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:14.125822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:14.131359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:14.131359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:14.131359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:14.131359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:14.131359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 285/580] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:14.131359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.134854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.195401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64188f-4938-4035-b85d-6b169a838329 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.206467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.227037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6b40f-af2c-4be7-91d3-f5bb5726aa73 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.229298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.230083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.230366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.230646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.240509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:14.248196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:14.249266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 296/581] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:14.250270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.265205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.266076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.266352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.266624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/947e9ae8d1a44654b3c294b849912707/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.281445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=947e9ae8d1a44654b3c294b849912707, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.282872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.296533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 286/582] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:14 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/947e9ae8d1a44654b3c294b849912707/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:14.297196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.350708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.359666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b2f2-f609-42a7-bef8-f693c825d2d1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.399104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.399864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.400265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.400554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.401406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=7f250dc336cc47a0ba8dd4c66ce717ba) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:14.401728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.403191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.416010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 297/583] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/role_assignments?user.id=7f250dc336cc47a0ba8dd4c66ce717ba&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:14.416010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.416321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fb7f2-e789-4586-8315-794633ac8a14 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.453805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.465753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.466456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.466744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.467023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.469827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:14.470197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.471962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.498534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 287/584] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:14.499432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.574929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a148c-7755-4e3c-b7ec-fe90f02620e3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.627217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.627436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7db74-4dc0-4f68-aff8-6dbf84a86cb8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.627888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.628208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.628493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.629502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:14.630722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.632677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.648611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 298/585] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:14.649509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.671803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.672427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.672707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.672982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.673766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:14.674043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.675419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.677495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.685300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 288/586] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:14.686217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.739038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.788889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54356c11-8fc3-404e-9aec-f34c69c67830 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.793428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49ea1b-21b8-405f-ba8c-673888740ae5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:14.832538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.833487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.833872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.834270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.834379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:14.835319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:14.835611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:14.835891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:14.843887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.846813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.848463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:14.850149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:14.868373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:14.869335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 09:46:14.870324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:14.875801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 289/587] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:14.876120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:14.877120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:14.878165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:14.878165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:14.878165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:14.878165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:14.878435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.879463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 299/588] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:14.880372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:14.971332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:14.996993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961634f4-6f1a-422b-9e1c-336fe82d74f0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.004583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2888b8c-a5cf-4fad-9ef6-d1b67174cf24 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.013414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.042972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.043741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.044121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.044497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.045416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:15.045798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.046912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.047429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.048136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.048596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.049128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.063449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.066082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.072324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 300/589] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:15.073291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:15.089600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:15.090617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:15.091501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:15.091501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:15.091501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:15.091501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:15.091501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 290/590] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:15.091501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.198238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc018635-df94-4a21-ad40-164181a1ead2 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.209076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30234bd-a54d-4090-a66a-d0d28eaca208 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.229590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.240180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.241106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.242149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.242580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.243663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:15.244181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.245591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.245971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.246635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.247021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.247399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.258770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.260010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 301/591] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:15.261045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.264813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:15.283686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:15.284871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:15.285969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:15.285969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:15.285969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:15.285969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:15.292463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 291/592] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:15.293471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.310028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.375388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe59a9-ca1b-42c3-9984-43719ba0b71c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.396562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300acd2-f242-448e-95cf-ba1022f1ffc7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.412433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.414031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.414465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.414996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.415893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:15.416375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.417946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.437464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 302/593] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:15.437464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.438227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.438923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.439210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.439488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.447154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.448647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:15.464317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:15.465238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:15.466115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:15.470619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 292/594] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:15.471461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.498405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.550198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.574732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9404745-df33-4686-abe9-24aca95dbc75 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.582078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337be15f-d890-428b-9df6-73d47367afdc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.618649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.619512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.619801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.620111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.621751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.623605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.624195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.624679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.625638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:15.626154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.628158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.628313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.629821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.643110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 303/595] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:15.644303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:15.651381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:15.652363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 09:46:15.653297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:15.657535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 293/596] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:15.658047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.762827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f755-c807-4483-a4b2-8458bcadec8c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.778547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac81c2-ba3d-4d46-a842-df3fc1d930e0 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.792393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.803916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.804759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.805039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.805312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.814679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.816854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.820342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:15.823508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.824808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.825274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.825752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.826764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:15.827261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.828907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:15.833678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:15.834631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:15.836115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 294/597] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:15.837339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.847393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 304/598] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:15.849040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:15.955212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78fcfb-5b56-403b-8f56-40d417ec3bd2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.966070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc62904-00b5-475f-85b2-9b7b04d5d8fa None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:15.990548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:15.991613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:15.992747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:15.993226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:15.994259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:15.994786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:15.996592 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.003329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.004010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.004313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.004589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.005377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:16.005687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.007198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.017473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 295/599] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:16.018948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.019796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 305/600] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:16.029070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.060342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:16.074556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:16.135928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346f06-a051-4b69-8544-2d2010568ad6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.154587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607b4c-f9b7-4a6c-83a7-8e9691d1d686 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.176523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.177458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.177742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.178026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/bb8e8cab0c654fc39a73caa7c718ae56/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.201729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=bb8e8cab0c654fc39a73caa7c718ae56, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.202754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.203172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.204083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.204593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.205065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.220050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 296/601] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:16 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/bb8e8cab0c654fc39a73caa7c718ae56/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:16.221213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.225073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.227532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:16.264645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:16.265615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:16.266492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:16.266492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:16.266492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:16.266492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:16.271390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 306/602] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:16.278679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.407458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d839-e175-4e69-8fd0-fa2cb5cf1528 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.409243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:16.424238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:16.448007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea309c0c-941c-41e8-b217-e96fe11eb229 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.459127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f49c4f-92e9-459f-8daf-41b04936bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.459127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f49c4f-92e9-459f-8daf-41b04936bcab None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.459590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f49c4f-92e9-459f-8daf-41b04936bcab None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.459883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f49c4f-92e9-459f-8daf-41b04936bcab None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/8c7daa59378346bb9466961ea4c7c447/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.480206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f49c4f-92e9-459f-8daf-41b04936bcab None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=8c7daa59378346bb9466961ea4c7c447, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.481933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f49c4f-92e9-459f-8daf-41b04936bcab None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.490481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.491208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.491540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.491812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.492563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:16.492871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.494232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.498548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 297/603] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:16 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/8c7daa59378346bb9466961ea4c7c447/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:16.500039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371bf4-b3f9-417b-82e8-228c4a5c9ea6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.500375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371bf4-b3f9-417b-82e8-228c4a5c9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.500656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371bf4-b3f9-417b-82e8-228c4a5c9ea6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.508112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 298/604] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:16.513622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7daf8-e832-4ae3-b899-c9afbc7af5fa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.513926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7daf8-e832-4ae3-b899-c9afbc7af5fa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.515143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7daf8-e832-4ae3-b899-c9afbc7af5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.520049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 307/605] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:16.529167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.545303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-41d7daf8-e832-4ae3-b899-c9afbc7af5fa None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:16.546657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-41d7daf8-e832-4ae3-b899-c9afbc7af5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:16.655629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 299/606] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:16.657432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715936-e632-4bed-a9d3-8df7dd65748b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.657812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715936-e632-4bed-a9d3-8df7dd65748b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.658088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1715936-e632-4bed-a9d3-8df7dd65748b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.663994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 300/607] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:16.665142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.665428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.665705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.693095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:16.694400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:16.703809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb18ee-6ffc-4585-a7c2-ae8b0c484cfb None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.743072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.744215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.744616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.744926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.752745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.754355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.758050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:16.771151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:16.772110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:16.773569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 308/608] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:16.774508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.781591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 301/609] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:16.782465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.800303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:16.883600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffce4c7-24be-4dca-8e27-2a52d74b131b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.898697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712e8c0-efe5-4f54-909d-c99d06ee6e73 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:16.917893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.918676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.918963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.919246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.930230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:16.937312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:16.938319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:16.939285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:16.940171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:16.940802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:16.941670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:16.942158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:16.943164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:16.943672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:16.944296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 309/610] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:16.945181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:16.945832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:16.960433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 302/611] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:16.961931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.006584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.043884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.049627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b36dad-e19c-4e99-9454-0e662e6e7ec8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.076539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1e4b-ba55-4026-9020-fa4e8d8ea087 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.084329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.085124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.085943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.086218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.097440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:17.106054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:17.107156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:17.108021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 310/612] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:17.108714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.127265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.128330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.128851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.129341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.130336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:17.130844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.132534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.141016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 303/613] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:17.142088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.216428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4bac7-60e3-4511-9dcf-614064fb4519 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.237234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.252701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3121151-ea8c-4364-b1c6-9280aa8b89a3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.252987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.253827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.254108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.254380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/1ea057364d054564b4c44f7a5d60f94b/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.270217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=1ea057364d054564b4c44f7a5d60f94b, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.271637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.289163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 311/614] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:17 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/1ea057364d054564b4c44f7a5d60f94b/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:17.290197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.292285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.293380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.293958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.294522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.295508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:17.296084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.297770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.300414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.312491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 304/615] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:17.317758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.423053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54286cc9-c8e2-4669-a173-b3e6416c4435 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.486922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.487736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.488047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.488329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.511094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.512612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:17.537836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:17.539282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:17.540614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:17.540614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:17.540614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:17.540614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:17.540614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 312/616] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:17.546430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.547937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2c686-3fe4-401f-a379-2a87a0dee5e0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.572889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.589287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.590093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.590376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.590653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.602844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.604509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:17.622944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:17.625133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:17.627108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:17.627108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:17.627108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:17.627108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:17.627108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 305/617] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:17.637185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.655803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb57e93-0eb4-40d7-991a-456869513f25 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.692188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.692849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.693134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.693411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.694200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:17.694511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.696485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.708857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 313/618] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:17.714918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.739766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.804952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:17.840658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfd005-a08c-4c05-a093-258a35efb69d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.846415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589630a-dd56-46c6-b69c-21fd937bf21a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:17.905922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.906922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.907207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.907631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.909492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:17.910251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:17.910631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:17.910999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:17.911847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:17.912277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.913777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.915945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:17.917471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:17.934327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:17.935611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:17.937249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:17.937786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 306/619] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:17.937858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 314/620] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:17.941245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:17.941382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.045406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae963b-f807-4ad3-a121-4ec8a7c19a86 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.081488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.082085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.082370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.082650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.083610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:18.083926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.085536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.119391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:18.120107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 315/621] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:18.123441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.182188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c3af-e531-4014-97aa-76b7fa152cbc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.198662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:18.234933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05c6d-8c58-4032-9f51-98cbd77d67de None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.252693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.253499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.253783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.254069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.262031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.263469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.279070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.280101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.280533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.280955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:18.287332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:18.289031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:18.290001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 307/622] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:18.297862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.357437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:18.360254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.362193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.469892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc782b86-de69-406d-86df-09b6a2a37d34 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.478200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 316/623] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:46:18.483815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.562965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.564046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.564534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.565012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.566069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:18.566578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.568915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.605255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 308/624] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:18.610609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.633630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10499d2-a5a4-4946-8f9d-255cfadb098e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.636297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:18.665356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:18.688421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.689600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.690100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.690381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.701609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.703404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-c4155e46-4774-4f80-9dd6-52180f1621cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:18.722517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:18.723434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:18.724365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:18.724365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:18.724365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:18.724365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:18.727289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 317/625] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:18.728974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5462d71-c96c-45e3-af18-335be550e6c6 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.729510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5462d71-c96c-45e3-af18-335be550e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.729979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5462d71-c96c-45e3-af18-335be550e6c6 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.735668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 318/626] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:18.737009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5462d71-c96c-45e3-af18-335be550e6c6 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.762155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca25971-09f1-4716-ab74-c90aabf4a060 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.806050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.806841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.807127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.807401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.819007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.820543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8afdfae1-5913-42f3-860c-1ee2a88b714a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:18.839822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:18.840875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:18.841865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:18.841865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:18.841865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:18.841865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:18.841865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 309/627] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:18.842545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.842829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.843100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.857767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5462d71-c96c-45e3-af18-335be550e6c6 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:18.860334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:18.861562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:18.894353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:18.895008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.895287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.895558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.896308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:18.896627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:18.898600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50212a3e-eb3b-4175-ab57-87882c0809d3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:18.914785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 319/628] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:18.914785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005054a-75bd-43ff-8938-2baa37118458 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:18.914785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005054a-75bd-43ff-8938-2baa37118458 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:18.914785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005054a-75bd-43ff-8938-2baa37118458 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:18.914785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 320/629] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:18.914785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005054a-75bd-43ff-8938-2baa37118458 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.930122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:18.940347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 310/630] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:18.945659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:18.959141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.029592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005054a-75bd-43ff-8938-2baa37118458 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.058061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6d219-4c01-423d-ab32-2685513c132e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.064575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.065620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.065906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.066177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.066892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:19.067546 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.069365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1775b5d-9d0b-4480-aebe-8309afc355c9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.081702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 321/631] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:19.082882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.083168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.083438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.099764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.100684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.101465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.101465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.104731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:19.105915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:19.109645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.111172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:19.126209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:19.127270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:19.128355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 311/632] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:19.128853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.177724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 322/633] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:19.178913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.181108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.213244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.250273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e9c33-a27c-49b9-920a-9ccad170a930 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.286382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.287273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.287620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.288002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.298797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:19.301441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7247835-ff46-4d7d-8081-474ce05879f3 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:19.307120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:19.308093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:19.308964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 312/634] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:19.309668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.342718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.343859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.344330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.344844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.352376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.353957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:19.369398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:19.370316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:19.371184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 323/635] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:19.372197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.416642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6509e4-e151-412a-a3a2-8df974d0d123 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.440146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.444546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.453302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.453968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.454255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.454537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.455324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:19.455640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.457131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.469754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 313/636] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:19.470545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.492307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3f1e2-c5f9-41a3-940a-3be75e359c68 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.529118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.529903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.530184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.530456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.540633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:19.548272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:19.549208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:19.550034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 324/637] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:19.550800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.580417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c3727-03a2-4644-b7e5-a53c5c01a75c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.617370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.618036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.618323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.618603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.619352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:19.619667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.621063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.629418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 314/638] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:19.630062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.657792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5b4a7-1084-45e5-b883-c153369ea7a3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.681677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.682790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.693986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.694667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.694950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.695224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.696032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:19.696342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.697764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.709362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 325/639] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:19.710139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.733083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b370f-e73b-4423-8bac-f9abc6268b83 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.765827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.766472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.766755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.767032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.767856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=947e9ae8d1a44654b3c294b849912707) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:19.768197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.769612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.775510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 315/640] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/role_assignments?user.id=947e9ae8d1a44654b3c294b849912707&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:19.776299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.832938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12141347-f493-422d-8a0f-e224bcfd17dd None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.883587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.883847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a872f-4752-46df-94f3-5569e478e751 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:19.884848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.885181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.885466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.886242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:19.886551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.887957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1117b4-b605-401b-a3db-bf860977c69b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.901997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 326/641] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:19.901997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb494ab-3cea-4cb3-85ff-579a8255c4ea None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.901997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb494ab-3cea-4cb3-85ff-579a8255c4ea None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.901997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb494ab-3cea-4cb3-85ff-579a8255c4ea None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.901997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 327/642] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:19.901997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb494ab-3cea-4cb3-85ff-579a8255c4ea None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:19.904559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.927082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:19.928005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:19.928318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:19.928573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:19.941495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:19.942888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:19.959005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:19.962216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:19.963352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:19.964924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:19.964924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:19.964924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:19.964924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:19.964924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 316/643] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:19.964924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.027650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb494ab-3cea-4cb3-85ff-579a8255c4ea None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.064398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7473-92a7-4611-b675-66f0b1795363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.065421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7473-92a7-4611-b675-66f0b1795363 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.065861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7473-92a7-4611-b675-66f0b1795363 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.066147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7473-92a7-4611-b675-66f0b1795363 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/7f250dc336cc47a0ba8dd4c66ce717ba/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.072597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7bd31-dc72-4b83-9977-623d391294fb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.083339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7473-92a7-4611-b675-66f0b1795363 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=7f250dc336cc47a0ba8dd4c66ce717ba, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.084872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7473-92a7-4611-b675-66f0b1795363 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.110174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 328/644] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:19 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/7f250dc336cc47a0ba8dd4c66ce717ba/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:20.110174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.110174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.110174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.118563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.119686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.120155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.120644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.133433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:20.134725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:20.139292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.140889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:20.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:20.165582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:20.166650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:20.166650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:20.166650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:20.166650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:20.167578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 317/645] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:20.168060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.191458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:20.236463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 329/646] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:20.237474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.282730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:20.305359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf20a47-cea6-4765-b434-cc7bae7a8366 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.342772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.343438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.343721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.344017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.344947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:20.345338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.346852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.363132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 318/647] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:20.364001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.388745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3976e88-8ea4-4f33-81f7-691087457ade None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.428003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.428672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.429014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.429806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.430599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:20.430913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.432383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.444772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 330/648] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:20.445622 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.465357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:20.495036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce7ef8-9462-40db-8b7a-c22b480ce86a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.544785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.546028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.546509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.546995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.559300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:20.567553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:20.568522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:20.569367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:20.572125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 319/649] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:20.573212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.573691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:20.589883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3b05c-ef05-43ef-91fa-ddfc797b34e9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.634919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.636244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.636731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.637497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.647285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.649678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:20.667557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:20.668554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:20.669473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 331/650] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:20.670051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.699346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccb1cb-a117-4026-8517-97569a661f2f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.734715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.735787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.736315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.736805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.745459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.747111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.749138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:20.764164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:20.765121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 09:46:20.766024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:20.768585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 320/651] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:20.769609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.783127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b51ac1-d582-4b95-83d9-379c269448ed None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.819726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.820380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.820720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.820987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.821908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:20.822197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.823590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.833213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 332/652] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:20.834239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.849725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:20.879134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556ebd-174f-4108-b25f-77d6d6d87545 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.915150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.916246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.916777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.917245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.918314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:20.918815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.920512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.938569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 321/653] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:20.939623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:20.956234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284fe0a-58ab-4d87-a4f8-e73b9c916ff9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:20.994406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:20.995074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:20.995369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:20.995703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:20.996544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:20.996841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:20.998399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:20.999457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.023910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 333/654] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:21.025128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.048559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f8454-3b64-47c8-b6c8-fc2b923f030a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.087230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.087925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.088370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.088742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.098129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.101848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.103624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:21.124429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:21.125557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:21.126666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:21.126666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:21.126666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:21.126666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:21.128297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 322/655] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:21.129206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.143989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897fd3-3dc6-42b2-870e-1e1098046bf2 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.181526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.182553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.183023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.183505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.236171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358ae26-9cff-4343-b4ce-36fbabea4664 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.246370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.260757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.262543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.275830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.276686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.277070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.277365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.329281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.352489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.354066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.373027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 334/656] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:21.374094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.482888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 323/657] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:21.484077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.488131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292f924-fe1c-41d3-be22-7f038dffd376 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.495545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.527207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.528125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.528648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.529141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.530145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:21.530640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.532196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.549731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 335/658] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:21.550878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.579361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.588108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be4ed-4558-4cd8-974e-89f4a5e53f44 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.625945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.626916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.627029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.627285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.638421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.639872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:21.657828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:21.658936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:21.660025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:21.660025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:21.660025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:21.660025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:21.660025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 324/659] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:21.660318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.668056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dec9e2-7cdc-4406-a5b8-d2e30d65e95b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.706195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.707288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.707723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.708239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.720119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.721674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.723391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:21.743558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:21.744733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:21.745803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:21.745803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:21.745803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:21.745803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:21.747755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 336/660] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:21.748725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.769454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e20c2-2a37-4c2d-8cb4-1fbfb74ac775 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.804982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.805605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.805890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.806171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.813774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.815218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:21.831100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:21.832314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 09:46:21.833411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:21.836302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 325/661] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:21.837133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.840329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.870715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191de62-db66-4f4d-8936-01949ca8b0e3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.918196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.919162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.919549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.919925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.921276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:21.922206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:21.923897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:21.942914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 337/662] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:21.944064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:21.958969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7cc01-5f21-4070-9df6-8fb0f5f42ff8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:21.981580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:21.997196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:21.997866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:21.998168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:21.998725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:21.999252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:21.999567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.000978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.017856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 326/663] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:22.018737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.052908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d242422-7bce-4295-97f7-e9c41f324f5b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.091241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.091824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.092155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.092434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.093281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:22.093595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.096110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522ab6-a8c2-432c-a1a5-4e00dc0c0d47 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.099699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.118226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 338/664] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Jun 21 09:46:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:22.119541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477a80-95c2-4ef5-89f6-4226a20d5c81 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.119827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477a80-95c2-4ef5-89f6-4226a20d5c81 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.120129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477a80-95c2-4ef5-89f6-4226a20d5c81 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.124022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 339/665] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:22.124022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477a80-95c2-4ef5-89f6-4226a20d5c81 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.130330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e3131-31cd-4828-a261-bed5051a07e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.164865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.165642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.165920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.166215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.173161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.174583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:22.189529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:22.190465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:22.191344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:22.195416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 327/666] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:22.196275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.232373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477a80-95c2-4ef5-89f6-4226a20d5c81 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.241026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.266608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.267392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.267676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.267955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.275367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.276842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f0d4a106-5e6a-4ce4-86ad-cc2017ad9d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:22.291224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:22.292231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:22.293170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:22.297092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 340/667] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:22.298322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.298612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.298893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.299275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc63304-4cb8-4c5c-ae86-b179ff0c8b9f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.314714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:22.315903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:22.332541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b7cb-8a0b-40e8-9ac6-e8f5544d35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.333183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b7cb-8a0b-40e8-9ac6-e8f5544d35fc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.333468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b7cb-8a0b-40e8-9ac6-e8f5544d35fc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.333749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b7cb-8a0b-40e8-9ac6-e8f5544d35fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.369486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.387415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 341/668] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:22.388263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.417235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2b7cb-8a0b-40e8-9ac6-e8f5544d35fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.418762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed2b7cb-8a0b-40e8-9ac6-e8f5544d35fc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.457649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.488126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e4ec8-e4a9-4208-9f7a-eeda29f96532 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.516454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 328/669] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 09:46:22.517844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3484d1-cdba-45dc-841b-a216a4f3c3ab None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.518245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3484d1-cdba-45dc-841b-a216a4f3c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.518527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3484d1-cdba-45dc-841b-a216a4f3c3ab None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.520111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 329/670] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:22.520925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3484d1-cdba-45dc-841b-a216a4f3c3ab None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.526028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.526694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.526978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.527253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.528079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:22.528395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.530277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.543726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 342/671] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:22.544569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.588684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.624636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3484d1-cdba-45dc-841b-a216a4f3c3ab None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.642963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ee96-2acd-489c-812c-67b9711fc50d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.657541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.658192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.658476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.658756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.659530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:22.659837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.661294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.669568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.673686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 330/672] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:22.674558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.676115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1cc20-033b-4068-86e2-f6a8555da85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.676898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1cc20-033b-4068-86e2-f6a8555da85b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.677175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1cc20-033b-4068-86e2-f6a8555da85b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.677443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1cc20-033b-4068-86e2-f6a8555da85b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.687801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1cc20-033b-4068-86e2-f6a8555da85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-12e1cc20-033b-4068-86e2-f6a8555da85b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:22.696113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:22.697272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:22.698409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 343/673] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:22.699215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.699215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.699349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.715716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:22.716940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:22.777946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c046b7-174b-4598-9b84-76fa8d13c024 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.782585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 344/674] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:22.783459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.815225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.824923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.825713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.825993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.826264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.837416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.838893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:22.855895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:22.856980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:22.857888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:22.857888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:22.857888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:22.857888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:22.857888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 331/675] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:22.857888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.881121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded54643-b9f0-44c8-b7aa-9234ee5db499 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.908921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:22.915753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:22.916437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:22.916739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:22.917019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:22.917859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=bb8e8cab0c654fc39a73caa7c718ae56) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:22.918183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:22.919611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:22.925532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 345/676] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/role_assignments?user.id=bb8e8cab0c654fc39a73caa7c718ae56&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:22.926297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:22.959487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891855-1cd6-48dd-b7dd-04052469e5ba None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:22.999224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.000014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.000377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.000726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.001658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=8c7daa59378346bb9466961ea4c7c447) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:23.002050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.003616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.011668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 332/677] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/role_assignments?user.id=8c7daa59378346bb9466961ea4c7c447&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:23.025236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.040551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.047493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c106-18af-454c-bcea-e1b45f07db75 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.102378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.103498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.103957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.104480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.105313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:23.106228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.107219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.124321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 346/678] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:23.125433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.160862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8b5e-978c-479f-b426-cab45328f167 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.180201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.202116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.202924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.203512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.203806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.217471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:23.226994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:23.227945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:23.228827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:23.232067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 333/679] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:23.233887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.256951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62eb985-eb06-41bf-8ce9-af98ab14576a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.303778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.304985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.305270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.305553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.306279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:23.306919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.308289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.327522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 347/680] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:23.328529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.351003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.359700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b846c-4f9a-4dbb-9b81-9deac9504aa2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.404144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.405335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.405825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.406704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.421166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.423650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.433573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65378f5-2212-43da-9ed4-efe10bc3b209 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:23.446764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:23.447848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:23.448974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:23.448974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:23.448974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:23.448974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:23.455690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 334/681] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:23.455690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.477873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.478825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.479202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.479589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.480573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:23.480977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.482445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.490996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.498828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 348/682] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:23.500064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.576875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d719ea-8f23-440f-955e-4daee597ce4b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.590369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.613172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e642-fbb0-4ae8-9a16-aaed6533b045 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.620343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.621143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.621422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.621697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.632157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.633997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.650317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.651392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.651930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.652442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:23.652927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:23.653790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 335/683] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:23.659428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.660892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:23.661459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.663054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.685793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 349/684] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:23.688202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.758576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.772562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217eecd-9562-42a1-93bd-a732fd16bbbe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.808311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.809271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.809647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.810016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.813978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06d5a-4fbb-4d01-ad06-692cad19fb2c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.820836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.822396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:23.840663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:23.841758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:23.842811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:23.842811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:23.842811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:23.842811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:23.848960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 336/685] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:23.849974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.853783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.854627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.855130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.855556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:23.856527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:23.856976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:23.858562 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:23.871649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 350/686] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:23.872725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:23.876588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:23.959840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a1658-b8da-4f09-939d-231ce88b01a1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.977334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfa6a9-d706-4c2a-88f7-7b685078f6c5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:23.996503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:23.997437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:23.997813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:23.998570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.008543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.010090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.012481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.013015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.013935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.014362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.014780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.015795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:24.016345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.018046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:24.028973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:24.030099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:24.031234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:24.033452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 337/687] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:24.034405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.035101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 351/688] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:24.040776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.128356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.165238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa74412-ceb9-4752-9a23-9122712082ea None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:24.171407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6714c-ad93-44f2-a9a4-a8edbb66c631 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:24.201783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.202596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.202970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.203338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.204312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:24.204715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.206245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.213602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.214195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.214475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.214748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.215575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=1ea057364d054564b4c44f7a5d60f94b) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:24.215883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.217346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.223880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 338/689] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/role_assignments?user.id=1ea057364d054564b4c44f7a5d60f94b&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:24.224691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.236537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 352/690] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:24.242006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.294558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.340730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941723-509f-4f41-933c-c259cf4ba883 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:24.377908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.378712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.378990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.379266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.388007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.389461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:24.406392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:24.407581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:24.408792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 339/691] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:24.414234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.491871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47269f0f-1f5d-41f4-8fa1-9cb604aefb8a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:24.518253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.534889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.535581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.535865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.536167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.566349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf710c9-224e-4b46-8fe0-d5b302125883 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:24.598262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.611604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.612725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.613160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.614037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.615323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:24.615784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.615916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.618001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.618169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.640338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 340/692] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:24.649175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.785444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41697e8-e607-49f9-ba90-000bfdd461e5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:24.805713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 353/693] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:46:24.813446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:24.830279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e3bb-c904-4e03-8594-3dbfe4a91bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:24.831196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e3bb-c904-4e03-8594-3dbfe4a91bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:24.831651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e3bb-c904-4e03-8594-3dbfe4a91bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:24.832436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e3bb-c904-4e03-8594-3dbfe4a91bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:24.853136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.888929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:24.908704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e3bb-c904-4e03-8594-3dbfe4a91bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:24.917562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e3bb-c904-4e03-8594-3dbfe4a91bf6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:24.954293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015b04-5dbd-4992-8a31-d610fc176679 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.004067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.004872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.005228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.005508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.023824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.025306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:25.055600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:25.056538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:25.057411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:25.057411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:25.057411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:25.057411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:25.057636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 354/694] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:25.064894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.110275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 341/695] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 09:46:25.112381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b4b7-632f-4908-92e7-6a5c1df9ab27 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.112789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b4b7-632f-4908-92e7-6a5c1df9ab27 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.113588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712b4b7-632f-4908-92e7-6a5c1df9ab27 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.116056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 342/696] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:25.117599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b4b7-632f-4908-92e7-6a5c1df9ab27 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.182149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.210418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.224593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f13d6-3744-4344-9adb-cfed53918075 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.233666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712b4b7-632f-4908-92e7-6a5c1df9ab27 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.269933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.270933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.271365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.271829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.273335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:25.273858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.274857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.275550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c35eed-0c8b-45cd-bed6-78e48e85a9c0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.275857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.276272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.276658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.289150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 355/697] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:25.290649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.290784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.292425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.292977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.293268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.311121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:25.312302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:25.314772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:25.315660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:25.316626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:25.316626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:25.316626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:25.316626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:25.318929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 343/698] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:25.318929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.403998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 356/699] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:25.403998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.426106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e3f8-abf2-4d0f-9a6e-6abaf83cdb36 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.462441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.463233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.463513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.463801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.465925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.468935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.471904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.474132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c502d585-07f4-42ab-b854-78b69431d50d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:25.489005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:25.489888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:25.490810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:25.494968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 344/700] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:25.496290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66842ea4-eaa5-4829-8bbf-d340d5a2aaf9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.496584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66842ea4-eaa5-4829-8bbf-d340d5a2aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.496867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66842ea4-eaa5-4829-8bbf-d340d5a2aaf9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.498286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 345/701] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:25.501035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66842ea4-eaa5-4829-8bbf-d340d5a2aaf9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.512069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c274ea2f-1c83-4c13-aa61-9b0777694c8e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.547386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.548073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.548360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.548635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.549357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:25.549665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.551055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.563108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 357/702] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:25.563768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.612245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66842ea4-eaa5-4829-8bbf-d340d5a2aaf9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.647164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.648601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.648879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.649158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.650220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.651960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-d82d2088-590d-44e7-a8f1-e9bd07c7a6bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:25.667555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:25.668588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:25.669413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 346/703] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:25.670255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.670321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.671205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.679280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2028c0-5d8d-491b-b797-5e363a1e42d1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.689992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:25.691066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:25.704383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.718677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.719350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.719632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.719908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.720734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:25.721043 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.722898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.735555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 358/704] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:25.736684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.755639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.776037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 347/705] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:25.776037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.848852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c65b6-ee89-45e4-8287-d48e36a72039 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.880510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c81f4-c2bf-4c68-8972-0485176d5ee7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:25.884706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.885594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.885980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.886356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.893213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.894724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:25.908919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:25.910022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:25.911119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:25.914727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 359/706] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:25.915490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.919089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:25.920073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:25.920203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:25.920421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:25.921132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:25.921441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:25.922808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:25.932343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 348/707] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:25.932343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:25.965767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:25.982491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:26.024330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246869b3-5104-46a0-9f19-548206bf6674 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.032815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db95166-4370-4fe7-80d2-3a677155f369 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.058772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.059423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.059709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.060018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.060855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=947e9ae8d1a44654b3c294b849912707) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:26.061167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.062587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.068191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 360/708] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/role_assignments?user.id=947e9ae8d1a44654b3c294b849912707&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:26.069004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.070509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.070908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.071283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.080432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:26.083662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.085439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:26.107780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:26.108929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:26.109993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:26.109993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:26.109993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:26.109993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:26.116867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 349/709] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:26.118092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:26.209930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8c16c-1ac0-4f51-a55e-aa46e48bd64b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.219094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:26.252227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.252984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.253343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.253711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.254574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:26.254948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.256498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.260346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac1879-e6ef-4cb3-b84d-84331d7d8fcf None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.262928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:26.275038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 361/710] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:26.276080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:26.311563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.313674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.314111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.314533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.315385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:26.315859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.317389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.332566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 350/711] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 09:46:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:26.332566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:26.435449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf98682-0c39-4da0-a75d-ee3457738a13 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.508187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.509294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.509584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.509860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.510600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:26.510907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.512345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.536923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 362/712] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:26.539285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:26.541417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92b586-9ec4-448c-8796-96d5a045c99e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.578359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:26.591056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.591760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.592088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.592377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.593335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=7f250dc336cc47a0ba8dd4c66ce717ba) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:26.593654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.595142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9e9b6-a57d-4bb0-9330-cedab028a106 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.604979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 351/713] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:26 2022] GET /identity/v3/role_assignments?user.id=7f250dc336cc47a0ba8dd4c66ce717ba&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:26.687418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa657bb-0415-4571-9107-92448fdb69c1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:26.725891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3336e13-7998-45bf-aa7f-e69c2ff00548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:26.726964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3336e13-7998-45bf-aa7f-e69c2ff00548 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.727458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3336e13-7998-45bf-aa7f-e69c2ff00548 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.727943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3336e13-7998-45bf-aa7f-e69c2ff00548 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.728945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3336e13-7998-45bf-aa7f-e69c2ff00548 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:26.730634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3336e13-7998-45bf-aa7f-e69c2ff00548 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:26.755173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 363/714] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:46:26 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:46:26.763789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258ba2a-e239-48ae-b878-e87c9a149929 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.764782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258ba2a-e239-48ae-b878-e87c9a149929 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.765290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258ba2a-e239-48ae-b878-e87c9a149929 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.767500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 352/715] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:26.773815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:26.774441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:26.774924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:26.794134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:26.795902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:26.877084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 364/716] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:26.901177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258ba2a-e239-48ae-b878-e87c9a149929 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:26.945850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:27.027906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258ba2a-e239-48ae-b878-e87c9a149929 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:27.065486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:27.066326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:27.066614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:27.066890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] PATH_INFO: `/v3/services/network` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:27.067546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:27.068966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:27.081887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:27.083075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:27.084295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 353/717] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:26 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:27.089199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:27.115023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:27.209248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94edd-5082-427a-b09a-9040eb8ff0ec None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:27.246326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:27.246995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:27.247280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:27.247558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:27.248308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] RBAC: Adding query filter params (name=network) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:27.248618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:27.249987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255d8d3-5305-425e-905d-3e7d9891b8fc None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:27.255049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 365/718] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:27.260562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:27.361988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:27.369233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e3aa9-4006-41ba-9d16-54b1a004c84e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:27.403226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:27.403890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:27.404207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:27.404488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:27.405200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] RBAC: Adding query filter params (type=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:27.405511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:27.406881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8418efc-6ebd-4847-9bf6-09ea35b26f8c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:27.411716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 354/719] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:28.361088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e3c3-d680-4eff-8608-be6db3d31c85 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:28.361577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e3c3-d680-4eff-8608-be6db3d31c85 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:28.361577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105e3c3-d680-4eff-8608-be6db3d31c85 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:28.363133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 366/720] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:28.369045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:28.369446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:28.369627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:28.396929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:28.398157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:28.494237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 355/721] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:28.528195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105e3c3-d680-4eff-8608-be6db3d31c85 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:28.631868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:28.669595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105e3c3-d680-4eff-8608-be6db3d31c85 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:28.718001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:28.718787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:28.719067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:28.719341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:28.733791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:28.741409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:28.742804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:28.744677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 367/722] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:28.749059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:28.879856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:28.894825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224d92-d3ac-4ea8-bf6e-cf9204e0b431 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:28.946249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:28.946921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:28.947206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:28.947485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:28.948270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:28.948579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:28.949934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c333c-ad15-4c1e-b93e-feaa77a6f1f0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:28.964388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 356/723] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:28.969595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:28.981086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da4e34-eb12-4685-9e84-45afe9476a18 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:28.981381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da4e34-eb12-4685-9e84-45afe9476a18 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:28.981671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da4e34-eb12-4685-9e84-45afe9476a18 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:28.983764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 357/724] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:28.988355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122aba-bb8e-495d-bf97-910fdde264b1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:28.988653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122aba-bb8e-495d-bf97-910fdde264b1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:28.988935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21122aba-bb8e-495d-bf97-910fdde264b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.020980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-21122aba-bb8e-495d-bf97-910fdde264b1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:29.022195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-21122aba-bb8e-495d-bf97-910fdde264b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:29.098079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f7ce4-893d-417a-b261-8feb8bf9af8e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.144662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.145502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.145737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.146014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.149716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:29.156561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 358/725] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 09:46:29.158849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9417f-5dc8-4c76-9936-09e1f5139397 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.159770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9417f-5dc8-4c76-9936-09e1f5139397 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.160317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9417f-5dc8-4c76-9936-09e1f5139397 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.160527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:29.162013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:29.162799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 359/726] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:29.169694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.169694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.169694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:29.188419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:29.189363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:29.190267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:29.190267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:29.190267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:29.190267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:29.190267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 368/727] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:29.190973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:29.203484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:29.204719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:29.285178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 360/728] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:29.286049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:29.310532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8b35f-5b31-45af-a796-ff03047a4e4f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.315522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:29.352020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.353394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.354132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.354625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.355751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:29.358040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:29.379689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 369/729] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:46:29 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:29.382752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:29.438131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b446b-23a6-4348-b4e8-29b3976dccb5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.495760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.496479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.496790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.497108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.497853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:29.498842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:29.500869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:29.517483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 361/730] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:29.521805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:29.522988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:29.607371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852197e-05e0-461f-8096-79f3f3f28513 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.638405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:29.656483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.657279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.657565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.657843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.675075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:29.684098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3c722-b18b-4a14-9fe0-b5b7fd1590db None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:29.687050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:29.688032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:29.688915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 370/731] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:29.694635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:29.734007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.735295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.736784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.737076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.747628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:29.749126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6cb0099f-827f-4800-9cd7-7754b20fc7aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:29.769244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:29.770265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:29.771280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 362/732] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:46:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:29.776317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b2073-2f63-49fc-a73f-b2b1f0381331 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.776832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b2073-2f63-49fc-a73f-b2b1f0381331 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.777452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b2073-2f63-49fc-a73f-b2b1f0381331 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.778939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 363/733] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:29.779521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b2073-2f63-49fc-a73f-b2b1f0381331 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:29.840151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83e45-102c-4e1f-86b1-7b7ab5a68aed None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.851711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:29.879495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.880589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.881103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.881586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.882606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:29.883131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:29.884734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48621a0-2e7d-40bd-8be7-5f0984c0bb9a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:29.892848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b2073-2f63-49fc-a73f-b2b1f0381331 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:29.899484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 371/734] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:29.901133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.901665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.902149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.919516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:29.921041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:29.922250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:29.931740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:29.932456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:29.932796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:29.933075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:29.933969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:29.934284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:29.935722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:29.958520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 364/735] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:46:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:29.958520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.009905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 372/736] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:30.011093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.063004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12f364-4f42-404d-af82-14b696de4e8a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.099577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.100600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.101039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.101414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.112162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.113724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.121203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.125071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd875e-68fc-4558-99ae-8b152e08d37c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:30.134038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:30.135000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:30.135989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:30.135989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:30.135989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:30.135989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:30.140541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 365/737] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:30.141341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.168888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.170688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.171282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.171848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.183564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.184968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.186817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:30.205109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:30.206063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:30.206935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:30.206935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:30.206935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:30.206935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:30.206935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 373/738] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:30.207219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.254470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70976d-25a7-49a4-82d2-fb461b9bd6c8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.290953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4003a-4428-466b-8c00-c46012358cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.291921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4003a-4428-466b-8c00-c46012358cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.292421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4003a-4428-466b-8c00-c46012358cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.292766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4003a-4428-466b-8c00-c46012358cc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.304867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4003a-4428-466b-8c00-c46012358cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:30.310644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d2264-c228-455b-ba18-4e1bcd7eb2f2 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-23e4003a-4428-466b-8c00-c46012358cc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:30.314870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:30.315743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 366/739] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:30.323104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18a763-6b48-440a-b02a-f90324ef5dc0 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.323872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18a763-6b48-440a-b02a-f90324ef5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.323872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18a763-6b48-440a-b02a-f90324ef5dc0 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.323872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 367/740] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:30.323872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18a763-6b48-440a-b02a-f90324ef5dc0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.346304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.347165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.347551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.347754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.348503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:30.348811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.350168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.361839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 374/741] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:30.362857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.378183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.439385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.445939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18a763-6b48-440a-b02a-f90324ef5dc0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.462862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df72485-74c4-4606-a075-834b0d8d6541 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.479911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.480676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.480968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.481250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.481973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:30.482278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.483682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9fb77-0b48-4ee6-b9ec-55fe8f8a8cc8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.496765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 368/742] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:30.497984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.498274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.498553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.504644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.505248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.505529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.505801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.506546 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:30.506850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.508810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.515876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:30.517112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:30.517719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 375/743] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:30.520852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.588370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 369/744] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 09:46:30.589246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.611005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.640421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de770f1-3ef3-4739-a78d-47358981e298 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.678600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.680310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.680797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.681336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.690252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.692112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.694195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.706497 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926c205-2e3f-4a88-864f-2bd77e050bfc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:30.710401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:30.711517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:30.712680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:30.714697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 376/745] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:30.715743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.747796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.748628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.748916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.749198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.755875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.757847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:30.771313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:30.772240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 370/746] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:30.773276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.825345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70995667-c0ef-4605-9308-384b604016a1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.860040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.861065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.861529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.861974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.864061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:30.876554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.878077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.883286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ce935-f304-486c-9abd-6a758384b289 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:30.896958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:30.897883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:30.898768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:30.898768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:30.898768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:30.898768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:30.898768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 377/747] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:30.899477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.921483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:30.922410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:30.922899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:30.923178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:30.923894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:30.925291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:30.948006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 371/748] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:46:30 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:30.948006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:30.965590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.025535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb456726-2983-4cbb-9e2e-c116db0226df None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.078563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.079598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.079881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.080183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.081047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:31.081359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.082832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.100934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a602bb-a8ee-4edb-96a5-579ef1e8970f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.113028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 378/749] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:31.114210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.147087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.148387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.148675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.148954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.149916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:31.150230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.151704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.166184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 372/750] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:31.168330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.170340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.248201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.249042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961897f-1e54-4c57-84c1-259a6f32e0d5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.287648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.288791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.289313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.289765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.290726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:31.291223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.291656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e51f-af13-4eab-ba70-37527bb36fac None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.293000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.312063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 379/751] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:31.313162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.337184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.338145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.338609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.339061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.411265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.413217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.419784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.423772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c21cea-7557-4450-8aa3-0ca43ff6a07f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.460252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.461328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.461676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.462022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/947e9ae8d1a44654b3c294b849912707/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.464725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=947e9ae8d1a44654b3c294b849912707, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.466321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.486492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.500502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 380/752] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:31 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/947e9ae8d1a44654b3c294b849912707/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:31.501646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.573087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 373/753] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:46:31.579651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.643367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27790aaa-1a29-4ae6-9ad4-9c5bad774de0 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.696177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.697610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.698080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.698688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.710214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.711671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.715532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192ec5-a5ce-4f72-948d-b6ab8da39322 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-004a408e-51ab-452d-a076-d06848b5a5d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:31.727654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:31.728657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:31.729568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 381/754] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:31.730849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94726b6-853f-4c0d-838d-89f5b680a718 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.730849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94726b6-853f-4c0d-838d-89f5b680a718 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.731020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94726b6-853f-4c0d-838d-89f5b680a718 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.732439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 382/755] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:31.736969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94726b6-853f-4c0d-838d-89f5b680a718 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.766419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.769422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.770559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.770852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.771130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.785548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.787113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-58be8294-06cf-43db-89d1-108a504a50ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:31.811896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:31.812873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:31.813769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:31.813769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:31.813769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:31.813769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:31.813769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 374/756] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:31.814721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.815475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.815475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.840902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:31.842027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:31.860317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:31.865839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94726b6-853f-4c0d-838d-89f5b680a718 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:31.909239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:31.910196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:31.910480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:31.910758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:31.911798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:31.912138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:31.913674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:31.920090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 375/757] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:31.921053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:31.933588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 383/758] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:31.939009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.033934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.048435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7cfa7-f14b-4fe8-8205-7acb79de2202 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.062893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc86b5-a39b-424b-88a0-e1abc65bad6e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.086133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.086795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.087081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.087356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.088121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:32.091505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.095290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.107008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.108010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.108981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.109464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.112107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 376/759] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:32.117324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.131568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.199193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.200901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.242849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2325a-0093-49dc-aaa0-6f3e9b2e5803 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.279021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.280256 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.280393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.280705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.281431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.282863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.294032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:32.298683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:32.299633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:32.300507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 377/760] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:32.307390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.331040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 384/761] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 09:46:32.331040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.393550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.422049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037483a-c7bc-42c6-a2b3-54174e3c4028 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.436779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922cb14-1dc5-4cd8-9d22-260747b2fde7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.459342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.460667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.461153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.461646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.469138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.470777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.470905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.471510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.471794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.473231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:32.473539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.474871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.484515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 385/762] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:32.484515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:32.494729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:32.495996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:32.496900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:32.503807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 378/763] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:32.505047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.525289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.581395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797996-6df5-45c5-aa01-a01ab2852cd4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.612695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216982d9-4722-4bee-a9d0-c9b8d08a6775 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.616356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.617142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.617423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.617698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.627786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.629366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:32.648359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:32.649262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:32.650144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:32.650144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:32.650144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:32.650144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:32.652057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 386/764] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:32.653102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.657434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.658430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.658914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.659391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.660362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:32.660891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.662476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.664235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.674965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 379/765] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:32.676168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.759089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dfbc2-d20e-4cc6-a268-d43752af69b7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.780359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.784913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7c44f-c42b-40bb-8eba-4c3ee7158af1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.796582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.797252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.797673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.798127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.798921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:32.799257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.800712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.818970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 387/766] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:32.818970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.829935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.830945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.831448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.831921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.832906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:32.833502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.835168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:32.848127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 380/767] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:32.849255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:32.923873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:32.942744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be97b-5109-440e-b731-8ad850aef2ce None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.976630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d068d4-7616-4f22-997c-1924494c978c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:32.991875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:32.993337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:32.994391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:32.994998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:32.996129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] RBAC: Adding query filter params (interface=public, service_id=5b794cb2bc7f48b8b63a7d7b2c0a91b1, region_id=RegionOne) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:32.996849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:32.998820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.014682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 388/768] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/endpoints?service_id=5b794cb2bc7f48b8b63a7d7b2c0a91b1&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:33.014682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.023571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.024540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.025027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.025615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.026896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=7f250dc336cc47a0ba8dd4c66ce717ba) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:33.027417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.029168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.033438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:33.044901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 381/769] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:32 2022] GET /identity/v3/role_assignments?user.id=7f250dc336cc47a0ba8dd4c66ce717ba&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:33.046932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.127451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af4fec-966b-4a96-b9bd-a68cb8aa193e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:33.192020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.192852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.193137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.193461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.201945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.203446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.213221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d12cc-f027-450b-aa05-d5fa9e4a9dda None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-087b4242-2462-471e-8b64-354a3a93afaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:33.219027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:33.220158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:33.221248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:33.225502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 389/770] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:33.227552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014712b9-0e73-4c63-ac31-b5f9c1487e78 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.228004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014712b9-0e73-4c63-ac31-b5f9c1487e78 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.228389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014712b9-0e73-4c63-ac31-b5f9c1487e78 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.230359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 390/771] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:33.235530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014712b9-0e73-4c63-ac31-b5f9c1487e78 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.249467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:33.261885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b045e-e3ff-4af7-9072-882c68f54474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.262557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b045e-e3ff-4af7-9072-882c68f54474 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.262844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b045e-e3ff-4af7-9072-882c68f54474 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.263126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b045e-e3ff-4af7-9072-882c68f54474 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.263822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b045e-e3ff-4af7-9072-882c68f54474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.265225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b045e-e3ff-4af7-9072-882c68f54474 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.270816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 382/772] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:33.280067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.280526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.280817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.323948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:33.325213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:33.341379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:33.369028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014712b9-0e73-4c63-ac31-b5f9c1487e78 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:33.416942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.417874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.418323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.418796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.419835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:33.420536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.422432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.439109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 391/773] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:33.445030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.483278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 383/774] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:33.508590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.602173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b68ec-e3fc-4379-aaf4-6009b382f2d9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:33.616295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3f027-b90f-406f-aa97-b019a3107464 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:33.633581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:33.640007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.640694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.640979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.641257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.642098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=125703637f434bc5b425cc979de91263) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:33.642410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.644115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.652400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 392/775] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/role_assignments?user.id=125703637f434bc5b425cc979de91263&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:33.656083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.657197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.657710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.658213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] PATH_INFO: `/v3/services/network` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.659094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.660806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1f1ce1a6-5bc6-4a8b-aa9e-0be10e38815b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:33.674622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:33.675663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:33.676531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:33.679429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 384/776] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:33.685590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.692395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:33.738074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf451-fc83-4efa-ac87-e6f08d9186f6 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.738440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf451-fc83-4efa-ac87-e6f08d9186f6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.738688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf451-fc83-4efa-ac87-e6f08d9186f6 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.740390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 385/777] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:33.751087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.751366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.751642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.779544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:33.780791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:33.839841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894a25-db82-46a6-9f8f-ae43cb1562c4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:33.898859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:33.899740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:33.900299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:33.900524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:33.901230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] RBAC: Adding query filter params (name=network) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:33.901538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:33.902922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:33.904903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 386/778] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:33.915457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 393/779] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:33.920651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:33.931825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.017020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:34.053897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1edbcb-226e-4132-a1f5-b4544a09853f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.098312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.099117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.099416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.099676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.125918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bedf4-6a00-46a2-9103-8cf16afac2bf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.128065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:34.143814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:34.144782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:34.145616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:34.146957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 394/780] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:34.154505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:34.169395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.201890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.202573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.202859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.203139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.205619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:34.205937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:34.207327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:34.217755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 387/781] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:34.226060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.322591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860f2eb-a153-4257-83e8-ccc4e7469bbb None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.356348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:34.360649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.361542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.362034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.362323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.363290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:34.363616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:34.365594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:34.385990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 395/782] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:34.391127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.439475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b653a3-e47b-49ae-a432-fbded23e74d7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.503067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.503734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.504039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.504322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.505114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] RBAC: Adding query filter params (interface=public, service_id=36c0e7f50d694ecbb8150f43abef43c6, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:34.505426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:34.506813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:34.515542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 388/783] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:46:34 2022] GET /identity/v3/endpoints?service_id=36c0e7f50d694ecbb8150f43abef43c6&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:34.520945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.561669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:34.623188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28083316-f34a-499e-a5aa-ee006aace806 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.636586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ff634-ef39-445e-bb1c-e458039b7554 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.657420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.658138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.658472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.658760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.659447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:34.660851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:34.667051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 389/784] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:34 2022] GET /identity/v3/services => generated 772 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:34.702587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.703408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.703696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.703999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.726643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:34.728284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:34.751715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:34.753881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:34.755997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:34.755997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:34.755997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:34.755997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:34.755997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 396/785] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:34.761351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.883005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417170a-82c0-4483-9ad4-f61aaf1d617b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:34.885654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:34.918470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:34.919139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:34.919424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:34.919703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:34.920471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:34.920778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:34.922141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:34.935136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 390/786] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:34.940438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:34.994344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:35.060288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688e8d3-ca53-4206-98c1-1c74f05c97c9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:35.118577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:35.119377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.119665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.119950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.134328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:35.135716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:35.154454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:35.155407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:46:35.156388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:35.160140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 397/787] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:46:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:35.161763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:35.290409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26768-3614-4396-b513-d6bef1e2c241 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:35.324670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:35.325341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.325624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.325902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.326733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:35.327043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:35.328551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94f6ba-25dd-48ef-8b7b-4d1a450cf1ff None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:35.346732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 391/788] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:46:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:35.352915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:35.436686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713dde3-586d-43e9-83c4-94e5cb553101 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.436999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713dde3-586d-43e9-83c4-94e5cb553101 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.437165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713dde3-586d-43e9-83c4-94e5cb553101 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.438798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 392/789] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:35.451115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293132e8-2080-4123-a3ad-099c143af68f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.451416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293132e8-2080-4123-a3ad-099c143af68f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.451705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293132e8-2080-4123-a3ad-099c143af68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.484979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-293132e8-2080-4123-a3ad-099c143af68f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:35.486178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-293132e8-2080-4123-a3ad-099c143af68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:35.496749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b574a-9b56-4cfd-b7ef-5d49eaf4e278 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:35.503862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:35.518536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:35.531599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:35.532360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.532695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.533170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.637346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 393/790] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:35.662587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293132e8-2080-4123-a3ad-099c143af68f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:35.699540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:35.700974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:35.816763 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:35.821186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 398/791] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:46:35.826790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:35.867870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293132e8-2080-4123-a3ad-099c143af68f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:35.919726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62713144-3056-4da8-9d84-c9f69c033fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:35.921184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713144-3056-4da8-9d84-c9f69c033fcf None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.921689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713144-3056-4da8-9d84-c9f69c033fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.922733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62713144-3056-4da8-9d84-c9f69c033fcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.938374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62713144-3056-4da8-9d84-c9f69c033fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-62713144-3056-4da8-9d84-c9f69c033fcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:35.948712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:35.949889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:35.950833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 394/792] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:35.953558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff859-1ada-4349-a938-4728a09d3b78 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:35.953558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff859-1ada-4349-a938-4728a09d3b78 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:35.953558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff859-1ada-4349-a938-4728a09d3b78 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:35.953800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 395/793] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:35.956248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff859-1ada-4349-a938-4728a09d3b78 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:35.967383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bf6ab-7110-4233-ae9f-c402aeb3f90f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:35.975178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.007055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.008518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.008943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.009375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.020260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.022287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-d004a621-7440-469c-8710-35ae4d06a244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:36.042687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:36.043752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:36.044879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:36.044879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:36.044879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:36.044879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:36.046806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 399/794] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:36.048537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.049007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.049473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.067734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:36.069469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:36.097002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff859-1ada-4349-a938-4728a09d3b78 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.135349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.136097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.136380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.136654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.137168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.137454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:36.137835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.139784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.156177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 396/795] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:36.157580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.164685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 400/796] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:36.165870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.244098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.276180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d969f-d4af-45fe-9259-aeac405824b9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.301166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce225f-3eb5-4369-ac92-c68886e67571 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.310234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.310902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.311184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.311464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.312212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:36.312522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.313880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.325765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 397/797] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:36.326544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.342824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.343611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.343992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.344235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.354887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.356352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-8b50033c-3766-49e3-8bcd-ad29d43a4818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:36.374061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:36.374937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:36.375870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:36.375870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:36.375870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:36.375870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:36.375870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 401/798] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:36.376920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326268-9183-4139-9a69-d51632eb0d2d None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.376920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326268-9183-4139-9a69-d51632eb0d2d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.377060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326268-9183-4139-9a69-d51632eb0d2d None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.378365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 402/799] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:36.383390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5326268-9183-4139-9a69-d51632eb0d2d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.419595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.436053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d97318-0b99-469f-a8ee-22b25877c7d4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.468410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.474496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.475455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.475763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.476344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.477002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.478372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:36.490869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:36.492522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 09:46:36.498606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:36.499491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5326268-9183-4139-9a69-d51632eb0d2d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.499576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 398/800] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:36.499576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.535096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.535884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.536317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.536595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.544209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.545760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-9cd8bba1-5917-415e-814d-cbe6a6896f9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:36.560950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:36.561849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:36.562730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 403/801] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:36.563637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.563733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.564015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.580701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:36.581985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:36.603369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371cc86-eabf-4e8c-b52b-2116ac891668 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.639664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.640361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.640642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.640918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.641820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:36.641927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.643298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.652936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 404/802] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:36.653614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.670338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 399/803] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:36.671249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.683699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.732775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.761044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25082117-0692-42f9-b5a0-39359bda3607 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.781541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842500c-c886-4bc4-8487-c27faf1da757 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.794880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.795546 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.795832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.796147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.796851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:36.797161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.798521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.802889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 405/804] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:36.803650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.824575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.825647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.826071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.826487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.827541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:36.827851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.829310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.842069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 400/805] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:36.842904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.901841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.916349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a91a53-3dd7-45bc-9817-0e3e735f52b8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.948149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419fb50-464e-4186-a83e-17894d86c102 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:36.953082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.953875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.954158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.954436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:36.963603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:36.965068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:36.966570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:36.979922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:36.981014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 406/806] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:36.981983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:36.989692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:36.990501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:36.991048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:36.991048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.004655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:37.015425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:37.016572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:37.017590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:37.021635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 401/807] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:37.022538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.096539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ffaf9-f51d-4558-a03f-6ce843491ef3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.126405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbadd5e-7bb6-4932-8967-2fdcb0a67b92 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.131674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.132888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.133170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.133442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.134148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:37.134453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.135820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.141603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 407/808] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Jun 21 09:46:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:37.142378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.158623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:37.161824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.162549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.162834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.163150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.163969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=947e9ae8d1a44654b3c294b849912707) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:37.164376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.165786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.171844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 402/809] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/role_assignments?user.id=947e9ae8d1a44654b3c294b849912707&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:37.172643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.228289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:37.257851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b87b2c-f450-4c96-957d-a7a617a636a8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.295459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.296106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.296389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.296663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.297514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:37.297822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.299281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6af8e-2210-4d87-8eec-b4568e995b09 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.303518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b07e4-a319-46e6-910c-9139a93d5930 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.324860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 408/810] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:37.324860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acc2b8-c0a3-4832-999c-9f90f16f1791 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.324860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acc2b8-c0a3-4832-999c-9f90f16f1791 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.324860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acc2b8-c0a3-4832-999c-9f90f16f1791 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.324860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 409/811] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:37.325347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acc2b8-c0a3-4832-999c-9f90f16f1791 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.351338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.352047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.352341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.352617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.354228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:37.354546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.355914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.364248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 403/812] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:37.365056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.410301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:37.445789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acc2b8-c0a3-4832-999c-9f90f16f1791 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.465194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55328913-7835-41d2-ab92-ae722d0ef593 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.466721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:37.483182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8560a6-7b8c-461c-9716-3adfc9461cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.483832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8560a6-7b8c-461c-9716-3adfc9461cc5 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.484144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8560a6-7b8c-461c-9716-3adfc9461cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.484417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8560a6-7b8c-461c-9716-3adfc9461cc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.485140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8560a6-7b8c-461c-9716-3adfc9461cc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.486496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8560a6-7b8c-461c-9716-3adfc9461cc5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.501897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.502690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.502974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.503251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.520008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 410/813] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:46:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:37.520008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.520008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.520008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.520429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.520429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.539846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:37.541133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:37.541778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:37.542622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:37.543489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:37.543489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:37.543489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:37.543489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:37.548155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 404/814] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:37.550005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.646418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 411/815] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:37.647571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.677039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb3e01-9c01-43f1-8d52-fd28e0354ab7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.719554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:37.719887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.721070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.721358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.721633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.737043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.738748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:37.763276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:37.764408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:37.765474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:37.765474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:37.765474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:37.765474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:37.768122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 405/816] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:37.769263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.778814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9695-e5ac-4e9f-a95d-36e3babd8636 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.782420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:37.817207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.818232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.818714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.819201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.820183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:37.820689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.822509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.836220 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 412/817] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:37.837359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.900970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4be85d-07d3-4011-ba86-ad313c6886a5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.940886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:37.942054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:37.942550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:37.943018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] PATH_INFO: `/v3/services/network` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:37.943953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:37.945630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:37.959620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:37.960675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 09:46:37.961521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:37.962270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd51cf0-91f0-484e-8707-0b9cb2b949bf None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:37.964567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 406/818] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:37.965555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:37.980555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.008330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.009263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.009550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.009821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.010552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:38.010861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.012250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.029166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 413/819] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:38.030402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.052462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.087562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ec60-afab-43c0-9e79-0f2d5133c09b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.128586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.129833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.130315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.130821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.138478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.140336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.154877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992573c7-3dc6-48da-8630-2372344a57c3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:38.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:38.157608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:38.158570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:38.161016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 407/820] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:38.162133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.190169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.190838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.191121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.191428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.192145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] RBAC: Adding query filter params (name=network) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:38.192466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.193837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.203436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 414/821] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:38.203864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.239283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.278214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101aaad-5171-44d8-a441-e9ccb3ed6ce6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.306867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81948a67-eff3-4e56-9abd-456c5a279d6e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.309401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.318135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.320099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.320642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.321172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.332956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.335942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.343659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.344311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.344745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.344945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.345702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:38.346014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.347678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:38.356612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:38.357537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:38.358458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:38.361744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 408/822] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:38.362744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.367747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 415/823] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:38.368732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.469581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec061eb-8965-4594-bcbd-e53c5bf2251b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.472651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.496767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e854-710d-4592-a483-1ec9a4894691 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.509316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.510296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.511118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.511865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.513177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:38.513687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.516087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.537830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.538535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.538821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.539099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.539840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] RBAC: Adding query filter params (type=network) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:38.540274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.540476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 416/824] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:38.541452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.541566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.549834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 409/825] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:38.549834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.606406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.653599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0b10-d052-41d1-a5a9-a80124aaa79a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.688512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2091f-99ea-4c19-95c7-cfe06d45bc7b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.689079 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.689974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.690354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.690727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.702342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.703921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:38.723078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:38.724088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:38.724991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:38.724991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:38.724991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:38.724991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:38.729239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 410/826] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:38.730098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.735149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.736352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.736822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.737278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/7f250dc336cc47a0ba8dd4c66ce717ba/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.740322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=7f250dc336cc47a0ba8dd4c66ce717ba, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.743156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:38.771773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 417/827] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:38 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/7f250dc336cc47a0ba8dd4c66ce717ba/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:38.771773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:38.806036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.915332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8701-ca55-42cb-9b90-6761a9231cc8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.929647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:38.966638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc95fb8-c893-4cca-a337-0edd0dba9ba5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:38.989367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:38.989865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:38.990251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:38.990629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:38.992074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:38.993688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.016888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:39.017820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.018248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.018574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 411/828] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:46:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:39.018907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.019916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:39.020403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:39.022668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.037081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 418/829] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:39.043128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.195306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888373d-b2fc-48f2-9f2e-cf9174576dcd None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:39.233860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:39.235037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.235525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.236028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.243909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:39.245589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5e1c9dd6-edfa-4a8e-8a88-1fdb1e4d2b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:39.260480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:39.261406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:39.262378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:39.264828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 412/830] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:39.270341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.325106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71174-04a8-4371-9933-a6798bce304a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.325911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71174-04a8-4371-9933-a6798bce304a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.326523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e71174-04a8-4371-9933-a6798bce304a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.329277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 413/831] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:39.336208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.336799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.337298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.357640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:39.359157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:39.359855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:39.376173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:39.387474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1e8c5-6801-4b26-a67a-56438aab7b71 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:39.429254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:39.429905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.430190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.430469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.431269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:39.431570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:39.433285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.448931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 419/832] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:39.454366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.455147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 414/833] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:39.479852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.574397 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6a31e-d68c-41fb-8fd0-27abf6c5dc54 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:39.607706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86218c7-6ae2-4358-8ba7-55837e93f6b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:39.611021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:39.611919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.612226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.612504 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/125703637f434bc5b425cc979de91263/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.615144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:39.629743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=125703637f434bc5b425cc979de91263, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:39.631204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.652146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 420/834] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:39 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/125703637f434bc5b425cc979de91263/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:46:39.653584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:39.654743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.655294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.655775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.656678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:39.658410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-517bca6d-4f8b-4e2f-af26-df79d0162a3b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:39.672614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:39.673644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:39.674523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:39.677922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 415/835] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 21 09:46:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:39.685107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.795627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32f7b-60cc-46fd-a552-f1b3b86bff2e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.796189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32f7b-60cc-46fd-a552-f1b3b86bff2e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.796189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32f7b-60cc-46fd-a552-f1b3b86bff2e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.797816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 416/836] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:39.804324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a9199-4bf0-48b8-a6b7-602e797b89d3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:39.804546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.804546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.804546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.823917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:39.826599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:39.837877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:39.850121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:39.851337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:39.851737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:39.852045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:39.852872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:39.853181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:39.854577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:39.860061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 421/837] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:39.865699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.919636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 417/838] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:39.925541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:39.941546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:39.980974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72097ca9-a059-4512-a187-e4b7e9157400 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:40.020394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:40.021439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:40.021948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:40.022477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:40.023877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:40.024406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:40.026101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:40.031437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 422/839] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:40.060954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d0f22-564f-4f72-8cea-b3bceb7d07d9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:40.107485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:40.108809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:40.109372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:40.109864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:40.110780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:40.112514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:40.125985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:40.127047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:40.127909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:40.131082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 418/840] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:40.137610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:40.256390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bd0f1-ee7d-42ae-bfe6-5747f6db2346 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:40.272201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:40.301496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:40.302165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:40.302447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:40.302723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:40.303422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:40.304280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:40.305644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e308b-cfe1-4a74-9c82-fccd00e8651c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:40.310609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 423/841] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:40.315944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:40.325738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:40.419966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb52e7-843a-4c8a-b6b3-1ac5da6e8185 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:40.455189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:40.456272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:40.456755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:40.457253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:40.458166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:40.458665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:40.460266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a387eb-d235-4295-b7d6-d0f6e12a595c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:40.472154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 419/842] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:41.079480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b1915-9c02-4ae4-990b-dbe352566816 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.080016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b1915-9c02-4ae4-990b-dbe352566816 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.080129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b1915-9c02-4ae4-990b-dbe352566816 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.082478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 424/843] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:41.089364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab41401-6118-452b-8571-5517c17ff9da None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.091692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab41401-6118-452b-8571-5517c17ff9da None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.092003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab41401-6118-452b-8571-5517c17ff9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.113339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cab41401-6118-452b-8571-5517c17ff9da None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:41.114767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cab41401-6118-452b-8571-5517c17ff9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:41.179081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:41.185769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 420/844] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:41.209536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b1915-9c02-4ae4-990b-dbe352566816 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:41.316474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b1915-9c02-4ae4-990b-dbe352566816 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:41.353378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:41.354089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.354368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.354642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.365056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:41.372544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:41.373465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:41.374474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 425/845] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:41.380353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab41401-6118-452b-8571-5517c17ff9da None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:41.483677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab41401-6118-452b-8571-5517c17ff9da None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:41.518440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:41.519102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.519386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.519660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.520428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:41.520735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:41.522089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:41.531276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 421/846] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:41.536735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:41.575672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:41.646675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb83bb-56f4-4762-9112-1b8b335e63b9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:41.684841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:41.685690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.685973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.686248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.698126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:41.699590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-2a659b9a-96f9-4de6-a91a-db25b337a495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:41.717486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:41.719611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:41.721685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:41.721685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:41.721685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:41.721685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:41.721685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 426/847] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:41.724550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:41.788787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:41.789573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dd8e-5062-4951-835f-e7c5018878b3 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.789863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dd8e-5062-4951-835f-e7c5018878b3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.790144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880dd8e-5062-4951-835f-e7c5018878b3 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.791749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 427/848] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:41.796842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.797124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.797399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.816717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:41.818436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:41.830414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17487d8-7b94-4332-8b64-c151bdc7456f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:41.867943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:41.868635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:41.868913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:41.869192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:41.869916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:41.870227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:41.871599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:41.912516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 428/849] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:41.931196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:41.956380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:41.998646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 422/850] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:42.004812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.052627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337458f-aa4c-4ee8-91ab-6bec7f379cc2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.089105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.089898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.090181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.090453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.103012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:42.110919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:42.111856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:42.112730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 429/851] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:46:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:42.117903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.146057 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265814e3-5751-4a16-81ae-e82695203e68 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.178760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.196206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.197374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.197860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.198331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.203564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.209343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.211585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.226331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fffc9-6bd6-48b1-9402-257a7241b96c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e36f686c-1c8d-4e20-9f85-ec04d1a170ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:42.231390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:42.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 09:46:42.233368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:42.233981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 423/852] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:42.236201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82778c9-b874-4313-b665-a914969bc8b2 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.236710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82778c9-b874-4313-b665-a914969bc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.237222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82778c9-b874-4313-b665-a914969bc8b2 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.239618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 424/853] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:42.240718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82778c9-b874-4313-b665-a914969bc8b2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.267510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.268204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.268489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.268769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.269516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:42.269822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.271192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57ee0f-fc60-4a25-a49a-1af641239f59 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.279433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 430/854] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:42.280751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.281090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.281315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.302255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:42.303715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:42.357003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82778c9-b874-4313-b665-a914969bc8b2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.374377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 431/855] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:42.375053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.400244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.400914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.401197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.401474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.402312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:42.402620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.404125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.425931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 425/856] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:42.425931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.454747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.465188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.489716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f60ec-e530-462e-96e1-bc8c9724673e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.527300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.528120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.528400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.528674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.529418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720942b-54dd-4552-bc54-18235de38dfe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.539657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.541127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:42.558492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:42.559398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:42.560302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:42.560302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:42.560302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:42.560302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:42.560302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 432/857] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:42.560597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.573553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.574545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.575061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.575567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.576506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.578161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.596087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 426/858] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:46:42 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:42.597197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.677356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284853cd-bb03-4aca-bf6c-3e60281fa1c3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.704285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.715204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.726844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17153-a940-437e-842f-b7ff72cd1250 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.729084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df660c2a-d847-4025-ab9e-22160f2fa48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.729853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660c2a-d847-4025-ab9e-22160f2fa48c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.730265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660c2a-d847-4025-ab9e-22160f2fa48c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.730544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df660c2a-d847-4025-ab9e-22160f2fa48c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.771144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.771809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.773427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.773427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.773675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:42.773978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.775335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb60eac1-33fc-4565-b4c5-6845c5f17e66 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.789520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 427/859] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:42.790953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efef8-00e5-40ea-873c-577f50d700b7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.791242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efef8-00e5-40ea-873c-577f50d700b7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.791517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8efef8-00e5-40ea-873c-577f50d700b7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.792990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 428/860] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:42.796898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8efef8-00e5-40ea-873c-577f50d700b7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.813427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660c2a-d847-4025-ab9e-22160f2fa48c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.815067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df660c2a-d847-4025-ab9e-22160f2fa48c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.902040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8efef8-00e5-40ea-873c-577f50d700b7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:42.930193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 433/861] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:46:42.931556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.931847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.932164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.938067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:42.938935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:42.939213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:42.939483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:42.947388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:42.948861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:42.950075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:42.951462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:42.964511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:42.965556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:42.966504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 429/862] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:42.967086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:42.968843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:42.989472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.028430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 434/863] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:42 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:43.028430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.082927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990256-166d-432a-848a-0fe294406bf1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.122609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.123399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.123684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.123959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.134491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.136321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:43.153906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:43.160347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:43.161242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:43.161242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:43.161242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:43.161242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:43.161459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40cf5d-a415-42c8-acf3-f7a87078480d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.161910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 430/864] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:43.161910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.198354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.199023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.199306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.199581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.200439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:43.200751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.202170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.224673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 435/865] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:43.224673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.232309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.233676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.267647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346375f-72c7-411d-8b8e-e043dd842be8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.308188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.309258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.309542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.309815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.310891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.312722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.327923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 431/866] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:46:43 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:43.328762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.345790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5f5b-cec5-4289-98e4-e4a4c5aa6776 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.393581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.394703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.395130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.395580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.396507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:43.396999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.399217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.412917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 436/867] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:43.419529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.460705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c48df-9438-4450-a94b-fb67f2d836d2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.492349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.494150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.503236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.503888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.504219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.504496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.543098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e218-9909-4937-963a-b2d54bd13b89 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.583275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.584103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.584388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.584662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.593389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.594819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.596231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.597904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:43.615224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:43.616226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:43.617133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:43.619877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 437/868] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:43.625223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.712635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 432/869] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:46:43.720074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.729788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb95b18-b3da-4a5b-933f-316c02fff9c4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.754031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.757593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:43.767143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.767935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.768312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.768659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.769518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:43.769888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.771462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.789211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 438/870] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:43.790510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.843153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673116-beae-45b7-bb75-df994c6d38a2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.879091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.879812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.880199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.880558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.895774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.898648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.914973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8966c1-26dd-4897-9d5b-e581faee3714 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:43.921303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:43.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:43.923072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:43.923072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:43.923072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:43.923072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:43.927526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 433/871] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:43.928830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:43.961109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:43.962400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:43.962889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:43.963474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:43.964654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=7f250dc336cc47a0ba8dd4c66ce717ba) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:43.965176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:43.966812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:43.973582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 439/872] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/role_assignments?user.id=7f250dc336cc47a0ba8dd4c66ce717ba&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:44.025391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:44.046782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecb748-1db5-46c1-8cfb-2d77e7f733b0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:44.085562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:44.086680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.086963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.087238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.088003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:44.088327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:44.089877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:44.104797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 434/873] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:44.113106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:44.169625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:44.227495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ca139-1143-4456-9cf3-75ae42a9338d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:44.261402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:44.262192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.262470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.262741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.269525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:44.270982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:44.285797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:44.286684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:44.287783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 440/874] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:44.295541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:44.404662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a706023-52d2-4dd9-b2d6-ada21e2da0b2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:44.439631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:44.440761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.441240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.441706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.442688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:44.443241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:44.445482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b1d88-a7ca-4111-a9d0-f3c5365ece87 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:44.455426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:44.465183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 435/875] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:44.469038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:44.577076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2c480-cc79-4549-b3b7-a6db9eeb60cf None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:44.663313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a6111-a209-4241-94b9-282e85476fa7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.663646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a6111-a209-4241-94b9-282e85476fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.663884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a6111-a209-4241-94b9-282e85476fa7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.665560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 436/876] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:44.671249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.671564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.671812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.689503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:44.690720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:44.712347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:44.738241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:44.738972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.739316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.739652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.740582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=125703637f434bc5b425cc979de91263) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:44.740962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:44.743246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:44.750046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 441/877] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:44 2022] GET /identity/v3/role_assignments?user.id=125703637f434bc5b425cc979de91263&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:44.776602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 437/878] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:44.799596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:44.913459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40210e4-6dde-4c88-b0a8-e6cd0b15ee1e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:44.948309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:44.949117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:44.949395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:44.949668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:44.950322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:44.951674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:44.964636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:44.965589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:44.966428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 442/879] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 21 09:46:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:44.973883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:45.086698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a1b64-4113-41d6-8b7b-b9d6a1f81b8d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:45.118289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:45.125367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:45.126332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.126822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.127299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.128255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:45.128784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:45.130352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:45.136648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 438/880] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:45.142003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:45.183153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:45.250990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186aca6-3cba-494b-9e4b-7f77538dc74c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:45.284924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:45.285583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.285862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.286132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.286831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:45.287134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:45.289068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:45.294478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 443/881] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:45.299852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:45.404201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bd186-4866-4f42-b04c-e354f403d519 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:45.438491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:45.439402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.439885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.440367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.441317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] RBAC: Adding query filter params (interface=public, service_id=edb80c8c8ea04750ac1e5098bd02c5b0, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:45.441819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:45.443336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04c31d-a059-4f00-8df5-b64b0809648b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:45.449388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 439/882] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:46:45 2022] GET /identity/v3/endpoints?service_id=edb80c8c8ea04750ac1e5098bd02c5b0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:45.457072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:45.548551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00e2f-a1d1-4ce4-b988-d74e63fd5d5c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.548844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00e2f-a1d1-4ce4-b988-d74e63fd5d5c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.549107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00e2f-a1d1-4ce4-b988-d74e63fd5d5c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.551008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 440/883] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:45.556546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.557076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.557076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.559481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:45.563187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ba9ac-719b-471c-8b5b-359b78da931a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:45.576394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:45.577675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:45.599693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:45.600384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.600768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.601112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.601799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:45.603157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:45.609401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 444/884] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:45 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:46:45.645466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:45.659822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 441/885] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:45.683620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:45.793188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca10bc2-d24a-415c-8366-21d326b2ee11 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:45.831875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:45.832704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.832984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.833260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.833965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:45.835426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:45.847485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:45.848755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:45.849579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 445/886] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:45.855489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:45.960748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9f18-2817-4318-83b5-b2f598e059c1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:45.996360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:45.997048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:45.997395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:45.997680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:45.998407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:45.998711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.000147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.006297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 442/887] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:46.011609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:46.041136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:46.122094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014bbf5-14b5-47db-9eca-22499504d1d7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:46.158775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:46.159744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.160050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.160328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.161030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:46.161336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.162694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22bcaa6-71b3-4472-aae5-f338a136e137 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.167853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 446/888] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:46.173395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:46.192216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519201e-3b0f-4473-8243-9435a42954a0 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.192749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519201e-3b0f-4473-8243-9435a42954a0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.192749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519201e-3b0f-4473-8243-9435a42954a0 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.194764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 447/889] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:46.199557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.199842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.200157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.217926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:46.219113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:46.236380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:46.297027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbe568-73df-455e-8862-43aad8640dec None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:46.300111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 448/890] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:46.315130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:46.337880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:46.340024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:46.341067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.341425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.342096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.343364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] RBAC: Adding query filter params (interface=public, service_id=6481f479e71848d1bcb1cfc2b7922680, region_id=RegionOne) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:46.343679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.346304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.354491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 443/891] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:46:46 2022] GET /identity/v3/endpoints?service_id=6481f479e71848d1bcb1cfc2b7922680&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:46.360512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:46.425468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fe6bc-c5cf-47e4-939f-68e7c0458021 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:46.463302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:46.464190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.464538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.464880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.465635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.466994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:46.480413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:46.481454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:46.482357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:46.483126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43a29f-ca3b-46dd-9f8e-c65ca0984853 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:46.483201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 449/892] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:46.488738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:46.508369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:46.532036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:46.532710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.532994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.533272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.533953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.535831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.544009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 444/893] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:46 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:46:46.596564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:46.615645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52cf6-f30b-47f6-ab14-f4431734a1b5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:46.653956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:46.655017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.655528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.656042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.656973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:46.657488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.659096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c96f5b-3310-42b5-b6dc-d65062ba72f0 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.665876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 450/894] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:46.671835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:46.778466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fddc386-6025-4977-a5af-50422c12aa2a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:46.815615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:46.816699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.817221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.817703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.818705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:46.819275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:46.820922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d8c50-cd29-48be-8155-dbe7799b328d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:46.827652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 445/895] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:46.968644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122b4e6-e176-45c7-a495-eb1245f88e2f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.969273 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122b4e6-e176-45c7-a495-eb1245f88e2f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.969764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122b4e6-e176-45c7-a495-eb1245f88e2f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.971591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 451/896] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:46.978031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:46.978321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:46.978613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:46.998697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:46.999878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:47.043788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:47.072719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 446/897] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:47.099999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122b4e6-e176-45c7-a495-eb1245f88e2f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:47.208659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122b4e6-e176-45c7-a495-eb1245f88e2f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:47.246271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:47.247456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.247941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.248438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.259743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:47.268217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:47.269162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:46:47.270011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:47.273242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 452/898] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:47.283228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:47.385720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c5138-89ed-499b-bb64-6908045f8a28 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:47.420804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:47.421467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.421747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.422021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.422760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:47.423062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:47.424442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:47.432823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 447/899] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:47.438055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:47.450396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:47.543207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c65dc3-315b-4810-967e-a34dad991d14 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:47.578644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:47.579747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.580265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.580715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.591679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:47.593514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f81ed2f3-b48a-4cc7-ac21-b062d895fd18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:47.612174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:47.613115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:47.614089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:47.614089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:47.614089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:47.614089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:47.616123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 453/900] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:47.624027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:47.658633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:47.727547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974841d7-f0ad-4ab2-a5e3-fd8c301f5f08 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:47.758707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93c11-3063-4a56-825f-fe27800065e9 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.759131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93c11-3063-4a56-825f-fe27800065e9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.759512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee93c11-3063-4a56-825f-fe27800065e9 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.761564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 454/901] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:47.764740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:47.765570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.766026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.766283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.766571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.766804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.766901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.767730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:47.768195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:47.769933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:47.783185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 448/902] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:47.787419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:47.787419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:47.789688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:47.852184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:47.865114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 455/903] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:47.888869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:47.905944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:47.913824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b33a-748d-4c90-9465-78bfd46b107f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:47.954188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:47.955346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:47.955890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:47.956432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:47.964380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:47.966282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:47.982407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:47.983336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:47.984287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:47.987044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 449/904] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:47.993280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.009761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d556a3c-b8af-46d8-b6eb-24199ddf32ff None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.045619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.046800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.047327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.047910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.048806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.050479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:48.064493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:48.065399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 09:46:48.066247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:48.074389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 456/905] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:48.075928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.117758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce396bc9-3e18-4291-8ae0-b721df393c6e None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.134467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:48.157194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.158120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.158653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.159120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.160284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:48.160801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.162412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.182933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 450/906] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 09:46:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:48.183103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e4e69-574e-4741-8f2a-2bf2da50c4b4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.188066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.204430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:48.220441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.221756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.222183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.222947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.223845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:48.224353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.226529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.236292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 457/907] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:48.237649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.297008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f5bc1-233a-4382-8c1d-f585e1fa8d46 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.334277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.335072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.335428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.335779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.343066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f3bd-fa51-4731-80f2-162b72b861de None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.361911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:48.381816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.382745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.383218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.383745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.384691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:48.385241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.386791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.396142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 458/908] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:48.398876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.411549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.413698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.429877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:48.509553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12037f6-b2ac-454e-8d66-ebf14e152323 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.540937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 451/909] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 09:46:48.546367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.553973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.563937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.564614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.565126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.566071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.567745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.605937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 459/910] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:46:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:46:48.665811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814f5ff-246f-4d79-8dc1-6848d12909db None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.682628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:48.713005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.714159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.714676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.715128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.728303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.730158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-385cb02d-b9df-4807-bc0c-8af04c3b7e50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:48.749976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:48.751065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:48.751949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:48.751949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:48.751949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:48.751949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:48.754167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 452/911] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:48.759968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.762770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8520f-5ca6-43f6-a8d6-cb8f341b06c9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.763057 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8520f-5ca6-43f6-a8d6-cb8f341b06c9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.763352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8520f-5ca6-43f6-a8d6-cb8f341b06c9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.765409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 453/912] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:48.769569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.769861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.770142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.787155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:48.789047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:48.814952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:48.869723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 454/913] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:48.892656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:48.902811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533c3c1-26af-406f-8635-132f417bcf9f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:48.949489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:48.950076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:48.950768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:48.951056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:48.952100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:48.952413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:48.954520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:48.973795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 460/914] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:48.974807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.020534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a1ca2-85c6-4996-84aa-195c0b387355 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.024353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:49.063939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.064931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.065213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.065763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.066431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.067936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.077717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b406d447-0c0a-4663-99e9-4f000a8c300e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:49.081071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:49.082045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 09:46:49.082867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:49.083584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ac21f-7d3e-465f-90db-dfeab0742f88 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.083654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 455/915] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:49.084277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853b33-77a0-40d4-a8df-6f03388dcb72 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.084277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853b33-77a0-40d4-a8df-6f03388dcb72 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.084444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853b33-77a0-40d4-a8df-6f03388dcb72 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.089962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 456/916] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:49.089962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0853b33-77a0-40d4-a8df-6f03388dcb72 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.131294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.132146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.136033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.136033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.145228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.146667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-7fde3cc8-9172-4e4c-b0a7-3b54f124ce52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:49.160628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:49.161493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:49.162401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 461/917] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:49.163966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.164181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.164433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.181144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:49.182328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:49.205738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0853b33-77a0-40d4-a8df-6f03388dcb72 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.243774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.244462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.244745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.245020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.245716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:49.246021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.247370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.250787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 462/918] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:49.251458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.252328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 457/919] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:49.257628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.284329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:49.347366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:49.361669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cd78f-f9a1-4e13-8469-e9112ca76f88 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.368214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9e9e1-a617-4e66-94d5-be105568fd73 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.396849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.398011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.398300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.398562 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.399345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:49.399655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.401111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.403840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.404532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.404815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.405091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.405849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:49.406164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.407511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.418144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 458/921] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Jun 21 09:46:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:49.418739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 463/921] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:49.418835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.419135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.502590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:49.520551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91daadf3-c2eb-42cf-92bd-204ebb441f2c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.525319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3f4d-0e07-4473-9fe5-924703a12b5b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.557064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981f331-acec-4cfc-a396-d446e3b751aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.557728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981f331-acec-4cfc-a396-d446e3b751aa None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.558012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981f331-acec-4cfc-a396-d446e3b751aa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.558292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981f331-acec-4cfc-a396-d446e3b751aa None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.559002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981f331-acec-4cfc-a396-d446e3b751aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.559938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.560394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981f331-acec-4cfc-a396-d446e3b751aa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.560619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.560901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.561168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.561987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] RBAC: Adding query filter params (role.id=50a936dd8df743a5b1e5579c481e512a, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=125703637f434bc5b425cc979de91263) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:49.562301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.563694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.570179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 464/922] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:49 2022] GET /identity/v3/role_assignments?user.id=125703637f434bc5b425cc979de91263&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=50a936dd8df743a5b1e5579c481e512a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:49.572995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:49.574530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 459/923] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:46:49 2022] POST /identity/v3/services => generated 241 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:49.599732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:49.706733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728454-61a1-426a-8723-88d740af63b4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:49.753724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9003c7-2c92-42c5-87e3-4a897d4d6301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:49.754479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9003c7-2c92-42c5-87e3-4a897d4d6301 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:49.754876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9003c7-2c92-42c5-87e3-4a897d4d6301 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:49.755280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9003c7-2c92-42c5-87e3-4a897d4d6301 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:49.756163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9003c7-2c92-42c5-87e3-4a897d4d6301 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:49.758265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9003c7-2c92-42c5-87e3-4a897d4d6301 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:49.782342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 465/924] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:46:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:50.732820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43ba5b-af6b-44ee-b431-e4704e3ea630 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:50.733340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43ba5b-af6b-44ee-b431-e4704e3ea630 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:50.733340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43ba5b-af6b-44ee-b431-e4704e3ea630 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:50.734976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 460/925] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:50.740153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:50.740562 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:50.740747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:50.758097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:50.759259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:50.822233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:50.838980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 466/926] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:50.861739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43ba5b-af6b-44ee-b431-e4704e3ea630 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:50.972986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43ba5b-af6b-44ee-b431-e4704e3ea630 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:51.027788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:51.028549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.028837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.029115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.029775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:51.031247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:51.043408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:51.045715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:51.047707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 461/927] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:51.053462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:51.161368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9da718-dc97-46ef-a797-8f18cd7b5330 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:51.197165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:51.197822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.198101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.198374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.199073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:51.199380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:51.200762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9224-ed67-44f4-81d6-1577a821aa44 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:51.205954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 467/928] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:51.211623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:51.229144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:51.330070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269051d-bf4b-4fdb-8ddb-703f249d928c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:51.368337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:51.369301 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.369786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.370235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.371106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:51.371584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:51.373146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490839d0-2cbb-4a02-afec-5d2cbdce9fcc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:51.378401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 462/929] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:51.622601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4d23a-4d7d-4372-bfa1-c966d1d59a61 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.622949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4d23a-4d7d-4372-bfa1-c966d1d59a61 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.623134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4d23a-4d7d-4372-bfa1-c966d1d59a61 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.624721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 468/930] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:51.632813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e80dd-a9e1-4203-946d-406599c9d66f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.633210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e80dd-a9e1-4203-946d-406599c9d66f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.633581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e80dd-a9e1-4203-946d-406599c9d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.651097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-871e80dd-a9e1-4203-946d-406599c9d66f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:51.652315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-871e80dd-a9e1-4203-946d-406599c9d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:51.722997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 463/931] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:51.745805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4d23a-4d7d-4372-bfa1-c966d1d59a61 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:51.754849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad051a6-d4e0-44b2-98e5-e535c990555f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.755368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad051a6-d4e0-44b2-98e5-e535c990555f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.755519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad051a6-d4e0-44b2-98e5-e535c990555f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.757096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 464/932] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:51.761903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.762189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.762463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.767746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:51.781756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:51.783135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:51.817819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:51.872135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 465/933] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:51.884398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4d23a-4d7d-4372-bfa1-c966d1d59a61 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:51.894695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:51.922990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d4331-db41-4750-a89e-76a0577ead25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:51.924183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d4331-db41-4750-a89e-76a0577ead25 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.924671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d4331-db41-4750-a89e-76a0577ead25 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.925163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d4331-db41-4750-a89e-76a0577ead25 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.936016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d4331-db41-4750-a89e-76a0577ead25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-c22d4331-db41-4750-a89e-76a0577ead25 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:51.944739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:51.945660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:51.946493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 469/934] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 09:46:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:51.947658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540c40a-cfc7-4cae-b58c-da497dc31922 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:51.947755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540c40a-cfc7-4cae-b58c-da497dc31922 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:51.948115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540c40a-cfc7-4cae-b58c-da497dc31922 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:51.949437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 470/935] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:51.953164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540c40a-cfc7-4cae-b58c-da497dc31922 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.008665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d587a3f-6b52-45bf-91c5-d9dfe3d02993 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.039958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.045861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.046664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.046946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.047222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.047870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.049265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b60849ca-0e32-4905-9a14-bc7ccb467bf9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:52.061299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:52.062291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:52.063135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 466/936] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:52.064631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.064631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.064631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.068090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540c40a-cfc7-4cae-b58c-da497dc31922 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.082748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:52.084210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:52.085028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.111340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.112153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.112433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.112704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.113441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:52.113743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.115314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.130840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 471/937] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:46:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:52.131876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.164701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 467/938] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:52.165475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.245318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4152-b29b-473d-b55d-dffdaacde76c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.264177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b819977-83f6-4d07-9059-f22cb9b87f58 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.281436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.282364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.282848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.283319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.284369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:52.284893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.286575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.290023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.294317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 472/939] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:52.295399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.303339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.304688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.304969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.305238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.315969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.317421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:52.335643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:52.336597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:52.337476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:52.337476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:52.337476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:52.337476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:52.338050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.340307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 468/940] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:52.341387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.402610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c502-e1c2-4bcf-8bb0-e1be13ee8dd7 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.438677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.439267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.439543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.439816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.440799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.441966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.443387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING keystone.server.flask.common [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 09:46:52.443790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe21e9-f519-4654-9105-b92fcde8e73b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.463317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.sql.core [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 09:46:52.463317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 09:46:52.463317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [parameters: {'id': 'd933395e5722436f888dd941b6fc276f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 09:46:52.463317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80068) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d933395e5722436f888dd941b6fc276f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d933395e5722436f888dd941b6fc276f. Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application conn.query(q) Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 09:46:52.471218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result.read() Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 09:46:52.472094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application next(self.gen) Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application yield resource Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application next(self.gen) Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise self.value Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application session.commit() Jun 21 09:46:52.473348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.session.flush() Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application compat.raise_( Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 09:46:52.474248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 09:46:52.475163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application conn.query(q) Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application result.read() Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 09:46:52.479630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [parameters: {'id': 'd933395e5722436f888dd941b6fc276f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.482042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:52.485102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d933395e5722436f888dd941b6fc276f. Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 473/941] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Jun 21 09:46:52 2022] POST /identity/v3/projects => generated 262 bytes in 177 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:52.487697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.489735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.489735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.489735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.489735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.490510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:52.490510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.491760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.497505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 469/942] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:52.498200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.544762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.581401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.589120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613783d-0178-4fc1-860f-eb5a26b02c8e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.605300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987e4ec-5e46-434d-a213-032e5fb5a8ca None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.626293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.626945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.627228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.627509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.628261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:52.628575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.630145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.640833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.641765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.642047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.642320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.653208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.653387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 474/943] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:52.654200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.654746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:52.668614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:52.669536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:52.670415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:52.674639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 470/944] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:52.675319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.778264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36fac0-7f3f-4b20-9362-46832138eb6d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.787687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26923b5-bce9-4a6b-92f5-f691d2be7e79 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.789843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.813938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.814594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.814908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.815185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.815957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] RBAC: Adding query filter params (interface=public, service_id=143eedd041f14d13a35d75a9fb006400, region_id=RegionOne) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:52.816286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.817649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.828122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 475/945] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/endpoints?service_id=143eedd041f14d13a35d75a9fb006400&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:52.828122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.829759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.830988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.830988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.831195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.839744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.841233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:52.850520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:52.856334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:52.857286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:52.858218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 471/946] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:52.858797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:52.940388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d386850-16e7-4df6-8d46-e57c94f06f1f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.965392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa058021-e7d2-4478-bd73-4c736aecdbda None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:52.981829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:52.982493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:52.982776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:52.983053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:52.983818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:52.984157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:52.985586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:53.004058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 476/947] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:53.011673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:53.012414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.012700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.013040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.013734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:53.013853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:53.015208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:53.032826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 472/948] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:52 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:46:53.121861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:53.144448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f96e-30d9-41b8-b161-1ff3b6b03e6c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:53.185515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:53.186208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.186491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.186767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.187632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:53.187944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:53.189434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:53.211174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 477/949] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 09:46:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:53.216550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:53.248226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:53.336413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2c88-b37b-4a2b-853e-e17c38864900 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:53.373174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:53.374364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.374864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.375405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.387611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:53.389397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5c3a767f-21c0-402d-9939-fc3976b28261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:53.410765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:53.411777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:53.412864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:53.412864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:53.412864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:53.412864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:53.415165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 473/950] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:53.420753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:53.429665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467317-fee9-4707-a582-79fcd90ab9e1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.429972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467317-fee9-4707-a582-79fcd90ab9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.430232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467317-fee9-4707-a582-79fcd90ab9e1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.435762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 474/951] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:53.437045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.437329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.437599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.457050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:53.458232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:53.557997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea41a-069a-4857-b604-d1dcbe3249c1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:53.564484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 475/952] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:53.582803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:53.594765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:53.681202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:53.681869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.682146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.682419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.683143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:53.683444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:53.684846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:53.701838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:53.713838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 478/953] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:53.719103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:53.740287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2989e-fba3-4c07-9184-94a720d5a502 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:53.794225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:53.794883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:53.795157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:53.795431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:53.796199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:53.798192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:53.820805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 476/954] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:46:53 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:46:53.952158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9dcfe-e3a3-4b68-b687-f97dbcfaddd9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:54.019217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:54.020047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:54.020334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:54.020610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:54.033535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:54.035014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:54.052932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:54.054225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:54.055370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:54.057306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 479/955] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:54.063069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:54.136702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:54.170163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930210b-1487-40ee-b092-ff27a2fe97ea None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:54.204837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:54.205470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:54.205756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:54.206085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:54.206930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:54.207240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:54.208729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839eabc-2829-4a6c-89d2-8a0b91ed0d3a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:54.228112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 477/956] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:54.230005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:54.288227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:54.336085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5540a8e-85fc-4ab2-a1fb-9acc9ced671d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:54.370836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197a6f0-ed0c-4151-8059-e5dd0d1ae5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:54.371731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a6f0-ed0c-4151-8059-e5dd0d1ae5cb None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:54.372032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a6f0-ed0c-4151-8059-e5dd0d1ae5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:54.372306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197a6f0-ed0c-4151-8059-e5dd0d1ae5cb None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/125703637f434bc5b425cc979de91263/roles/50a936dd8df743a5b1e5579c481e512a` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:54.374699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197a6f0-ed0c-4151-8059-e5dd0d1ae5cb None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=125703637f434bc5b425cc979de91263, role_id=50a936dd8df743a5b1e5579c481e512a)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:54.376204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197a6f0-ed0c-4151-8059-e5dd0d1ae5cb None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:54.400144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 480/957] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:46:54 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/125703637f434bc5b425cc979de91263/roles/50a936dd8df743a5b1e5579c481e512a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:46:55.155587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938878f0-c24b-4643-a07b-1fbe7e14aee5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.156235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938878f0-c24b-4643-a07b-1fbe7e14aee5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.156235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938878f0-c24b-4643-a07b-1fbe7e14aee5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.157756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 478/958] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:55.163695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.164211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.164365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.181525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:55.183014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:55.250898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05828-956a-46dc-a003-1166a00f440c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.251276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05828-956a-46dc-a003-1166a00f440c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.251462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b05828-956a-46dc-a003-1166a00f440c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.253246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 479/959] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:55.255343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 481/960] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:55.259952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.259952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.259952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.275822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:55.277302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:55.278521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.323382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:55.364167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 480/961] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:55.380441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574197e-5879-4698-a148-ee06a0345fc2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.383061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.416911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.418058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.418625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.419215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.420096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.421676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:55.434701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:55.435807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:55.436866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:55.439482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 482/962] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:55.444610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:55.445371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.490267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add77d2-5f01-4cf8-b73e-130710a5a869 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.528204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.528900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.529181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.529456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.530168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.531608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.532956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING keystone.server.flask.common [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 09:46:55.546316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.sql.core [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 09:46:55.546316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 09:46:55.546316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [parameters: {'user_id': '1fae321af01e4b63a4b588a4bd796394', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 09:46:55.546316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80069) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 09:46:55.561039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e924226-d695-4230-80b2-f6f7c0056ffa None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() Jun 21 09:46:55.564262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 09:46:55.565183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application yield resource Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application next(self.gen) Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise self.value Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application session.commit() Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 09:46:55.566130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.session.flush() Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application compat.raise_( Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 09:46:55.567028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 09:46:55.568782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application conn.query(q) Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application result.read() Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 09:46:55.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [parameters: {'user_id': '1fae321af01e4b63a4b588a4bd796394', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:55.573100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 09:46:55.574781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 09:46:55.576958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 09:46:55.576958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 09:46:55.576958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 09:46:55.576958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 09:46:55.576958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 09:46:55.576958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:55.577750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:55.577887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 481/963] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Jun 21 09:46:55 2022] POST /identity/v3/users => generated 160 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:55.577887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.613078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.614301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.614633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.615105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.616108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:55.616480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.618145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.629603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 483/964] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:55.631346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.702077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a2bf-03c0-4b59-be68-e7cfbf20a772 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.729566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:55.750059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.751241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.751524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.751800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.754359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1be47c-082b-477b-b115-d97bf9efec09 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.761489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.763210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:55.782444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:55.783400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:55.784446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 482/965] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:46:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:55.789786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.798084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.799190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.799731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.800302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.801482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:55.801999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.804226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.810507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 484/966] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:55.816300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:55.855621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:55.893586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54b0d4-a24b-4317-a8f1-eb06159871d3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.927915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.929413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.929528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.929787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.930582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:55.930897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.932311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb1b92-4b21-423d-aed2-ad2968d4fbe4 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.933375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb8fe-2eae-4983-a69c-f90c68c57781 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:55.969503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e21408-8736-4bf8-b858-35831f3cad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:55.970564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21408-8736-4bf8-b858-35831f3cad7e None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:55.971060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21408-8736-4bf8-b858-35831f3cad7e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:55.971535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e21408-8736-4bf8-b858-35831f3cad7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:55.972513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21408-8736-4bf8-b858-35831f3cad7e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:55.974343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e21408-8736-4bf8-b858-35831f3cad7e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:55.976317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 483/967] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Jun 21 09:46:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:56.007250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 485/968] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:46:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:46:56.054751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1e25-a164-4f4a-b727-649492ab08f2 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.055044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1e25-a164-4f4a-b727-649492ab08f2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.055331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d1e25-a164-4f4a-b727-649492ab08f2 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.057121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 484/969] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:56.062857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.063141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.063414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.083141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:56.084437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:56.172813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 486/970] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:46:56.195929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1e25-a164-4f4a-b727-649492ab08f2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.243045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:56.310900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d1e25-a164-4f4a-b727-649492ab08f2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.346706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.347952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.348319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.348600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.349509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:56.351039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9cc31477-55a7-4560-b6b7-c8dd6dbc4a0c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:56.362863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:56.363852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:56.365019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 485/971] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:56.370402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.390039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:56.472306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0357c9-eebe-4022-a791-a19cf1ea61fc None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.481089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51393320-5c55-4383-a950-452f831c8c7f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.481382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51393320-5c55-4383-a950-452f831c8c7f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.481665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51393320-5c55-4383-a950-452f831c8c7f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.483182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 486/972] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:56.487865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.488275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.488567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.505739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:56.507270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.507397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:56.507932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.508244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.508521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.509227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:56.509533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:56.510886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:56.520338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 487/973] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:56.521373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.577252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 487/974] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:56.601354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.608326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:56.631465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf903d-ce46-4cee-98a6-0b9f355820b1 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.634376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:56.668543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.669210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.669496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.669778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.670483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:56.670796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:56.672211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:56.677014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 488/975] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:56.683199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.711149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eddc0-b51a-4704-b141-8590b21c0b01 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.747958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.749034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.749478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.749755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.760037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:46:56.768217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:56.769182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:56.770049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 488/976] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:56.776212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.793949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a23df3-a39d-4aa1-8547-88dc38f9fb39 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.830952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.831612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.831896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.832236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.833030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] RBAC: Adding query filter params (interface=public, service_id=475214662d9348efa9ba156a94a31721, region_id=RegionOne) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:56.833349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:56.835213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:56.844003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 489/977] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/endpoints?service_id=475214662d9348efa9ba156a94a31721&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:56.845633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.861841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:56.878823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:56.888318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8ec8-f26b-4348-bd98-64cf888d0339 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.924790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.925449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.925731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.926008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.926807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:56.927116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:56.928651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:56.937841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 489/978] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:56.942996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:56.956919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6927c2-0fb0-4021-813e-4673fe431071 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:56.993590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:56.994393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:56.994971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:56.995259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:56.995953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:56.997779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:57.005608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 490/979] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:46:57.050056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32c15f-1043-4e17-b6c8-44282e536223 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:57.089386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:57.090593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:57.091103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:57.091608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:57.104881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:57.106359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:57.125081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:57.126056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:57.126984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:57.126984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:57.126984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:57.126984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:57.128310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 490/980] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:57.132771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:57.221681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:57.248985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b16ef-afc1-4192-8f86-b82387f2390c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:57.292994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:57.294118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:57.294632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:57.295118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:57.296513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:57.297088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:57.299674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:57.317724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 491/981] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:57.318894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:57.328803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:57.420448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596ac2f-07b6-4474-baf6-9753f50be6e9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:57.453945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:57.454753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:57.455037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:57.455313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:57.463422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:57.464887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:46:57.481361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:57.482324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:57.483283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 491/982] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:46:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:57.489691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:57.590869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa9bf0-cf00-46cd-973f-82e7bbb56b63 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:57.624553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:57.625222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:57.625508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:57.625783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:57.626618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:57.626927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:57.628382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:57.630031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:57.652388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 492/983] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Jun 21 09:46:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:57.653812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:57.719541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:57.755582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39c936-6e37-4253-8234-4bbfe7477021 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:57.788878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:57.789523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:57.789807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:57.790087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:57.858179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:57.860126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:57.922228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:57.959634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 492/984] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:46:57 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 09:46:57.965151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.065174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068791e-31cf-4cf7-9aeb-6c809c8ed0ca None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.105665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.106488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.106769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.107041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.119821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.121296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-4c027693-52ef-471d-9246-bf24b37ad0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:46:58.139228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:58.140175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:58.141073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:46:58.141073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:46:58.141073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:46:58.141073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:58.141073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 493/985] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:46:58.146918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.151243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c9ec9-07d3-4cde-9722-0ce70d455289 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.151536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c9ec9-07d3-4cde-9722-0ce70d455289 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.151816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c9ec9-07d3-4cde-9722-0ce70d455289 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.153228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 494/986] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:46:58.158144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.158431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.158708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.177936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:58.179223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:58.221132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:58.251521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caa25e-800a-4438-872b-a2d85c58963d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.252241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 495/987] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:58 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:58.275270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.287310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.288227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.288652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.289070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.289909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:58.290364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.291715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.308004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 493/988] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:58.309553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.337872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:58.379884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc915569-7485-4a12-a9b0-480266393f1c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.413975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865cefd-ce89-4d99-8ff4-93cb087d5515 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.414807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.416005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.417155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.417623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.418537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.420096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:58.435098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:58.436133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:46:58.436983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 496/989] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:58.442101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.449840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.450631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.450916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.451190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.458052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.459487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:46:58.474818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:58.475772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:58.476706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 494/990] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:58.481530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.487289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:58.555600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10a07f-1992-445c-9507-581c674af17d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.569693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:58.585787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f705ada-0a39-4347-af4e-afc64e5735a7 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.593590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.594069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.594353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.594629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.595334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:58.595847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.597037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.603111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 497/991] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:58.608529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.624941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.625757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.626045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.626328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.627115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:58.627429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.628917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.641439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 495/992] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:58.646937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.717646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef29f8d-6297-4bc9-a2b9-2dc9bb419988 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.719494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:58.753937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.754281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36ada6-8103-44cc-b84e-65417bb65abe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.754603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.754887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.755166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.755873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:58.756213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.758108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.763308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 498/993] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:58.768773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.789294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.789981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.790268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.790544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.791374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] RBAC: Adding query filter params (role.id=50a936dd8df743a5b1e5579c481e512a, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=125703637f434bc5b425cc979de91263) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:58.791684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.793168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.808012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 496/994] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/role_assignments?user.id=125703637f434bc5b425cc979de91263&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=50a936dd8df743a5b1e5579c481e512a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:58.890403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e6d6-b7da-4ff4-bfb3-9de61f957b55 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:58.926590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:58.927168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:58.927449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:58.927722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:58.928602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] RBAC: Adding query filter params (interface=admin, service_id=143eedd041f14d13a35d75a9fb006400, region_id=RegionOne) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:58.928915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:58.930284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34701d4f-e196-41c7-806d-2572f6352981 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:58.936002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 499/995] 10.222.0.36 () {56 vars in 1249 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/endpoints?service_id=143eedd041f14d13a35d75a9fb006400&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:58.941906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:58.957109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:59.051997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86d32-0323-455b-adb2-49d061c017d1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:59.057114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2382-5a9a-4c92-a60d-9626f2174da5 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.057402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2382-5a9a-4c92-a60d-9626f2174da5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.057674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2382-5a9a-4c92-a60d-9626f2174da5 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.059213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 500/996] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:46:59.063862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.064178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.064460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.081633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:46:59.082795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:46:59.090033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:59.090705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.090992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.091273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.091990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:59.093405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:59.100774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 497/997] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:46:58 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:46:59.115540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:59.168014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 501/998] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:46:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:46:59.190363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:59.273582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:59.298831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb2f89-5a43-480d-a3cf-bf6f92c4272c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:59.334615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:59.335833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.336340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.336810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.337708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:59.339245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:46:59.352066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:46:59.353065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 09:46:59.353935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:46:59.357020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 498/999] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:46:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:46:59.362943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:59.467366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf4fc-22d0-4baa-9971-cbf85415613d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:59.503705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:59.504691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.505152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.505614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.506521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:59.507003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:59.508652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:59.513774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 502/1000] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:46:59.519667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:59.623333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f916700-1955-4ccf-9617-05383b7d7cdc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:59.655897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:59.656631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.656955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.657239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.657946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:46:59.658256 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:59.659616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825dfe5-bad5-492d-b49d-8d5708a9ef0c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:59.665208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 499/1001] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Jun 21 09:46:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:46:59.670562 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:46:59.695777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:46:59.791097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52371106-dda0-4976-9090-4e07c3b60182 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:46:59.824480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997aace8-30c0-4895-b289-abd1fbbb5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:46:59.825130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997aace8-30c0-4895-b289-abd1fbbb5e83 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:46:59.825448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997aace8-30c0-4895-b289-abd1fbbb5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:46:59.825689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997aace8-30c0-4895-b289-abd1fbbb5e83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:46:59.826412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997aace8-30c0-4895-b289-abd1fbbb5e83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:46:59.827770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997aace8-30c0-4895-b289-abd1fbbb5e83 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:46:59.852000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 503/1002] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:46:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:00.883135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983b13-1a1d-4f3e-a89e-2fcb3adf51a1 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:00.883651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983b13-1a1d-4f3e-a89e-2fcb3adf51a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:00.883729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983b13-1a1d-4f3e-a89e-2fcb3adf51a1 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:00.885232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 500/1003] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:00.890154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4f38-ded6-4491-b188-335bd6d4771b None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:00.890525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4f38-ded6-4491-b188-335bd6d4771b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:00.890706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4f38-ded6-4491-b188-335bd6d4771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:00.907363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d41e4f38-ded6-4491-b188-335bd6d4771b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:00.908572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d41e4f38-ded6-4491-b188-335bd6d4771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:00.985083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 504/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:00 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:01.007882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df983b13-1a1d-4f3e-a89e-2fcb3adf51a1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.010608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:01.131576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df983b13-1a1d-4f3e-a89e-2fcb3adf51a1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.155355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8ad30-f2af-4583-a2d9-d777fe1ad23f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.155594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8ad30-f2af-4583-a2d9-d777fe1ad23f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.155898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8ad30-f2af-4583-a2d9-d777fe1ad23f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.157294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 505/1005] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:47:01.162149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.162436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.162709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.166613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.167400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.167685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.167963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] PATH_INFO: `/v3/services/image` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.168642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.169993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.174835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:01.181982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:01.182561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:01.183547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:01.184427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:01.185218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:01.185290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 501/1006] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 21 09:47:01 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:01.189408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.254536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 506/1007] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:01 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:01.262612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:01.278256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.299556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f281-0bc2-44c9-857c-f44e4493c622 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.335827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.336515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.336798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.337071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.337764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] RBAC: Adding query filter params (name=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:01.338066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.339632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.344836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 502/1008] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:01.351086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.383244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271114a-306b-41c9-bc7c-668bfb43e824 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.419377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.420136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.420424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.420699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.421359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.422722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.425386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:01.436105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:01.437089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:01.437931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 507/1009] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Jun 21 09:47:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:47:01.443370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.459194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10d34c-35ad-4856-9fb5-20168989df90 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.490950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:01.498386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.499048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.499334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.499617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.500372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] RBAC: Adding query filter params (type=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:01.500684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.502049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.506659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 503/1010] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:01.563870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be4416-435b-4072-b127-116ebb0f7161 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.601626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.602308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.602593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.602873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.603600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:01.603913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.605340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.615324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 508/1011] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:47:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:01.616934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.726221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8143-b086-4b34-a810-efad3cf56786 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.760219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.760889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.761175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.761454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.762162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:01.762472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.763838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43012e39-cbea-4bb2-956b-6c2082b3f486 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.774069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 504/1012] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Jun 21 09:47:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:01.775192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:01.838702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:01.878128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012d06b-c838-4346-8061-6d60bcfdb7d8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:01.912062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031f271-5031-4848-8021-953b69a92cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:01.912703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031f271-5031-4848-8021-953b69a92cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:01.913017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031f271-5031-4848-8021-953b69a92cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:01.913294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031f271-5031-4848-8021-953b69a92cf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:01.914035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031f271-5031-4848-8021-953b69a92cf8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:01.915404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031f271-5031-4848-8021-953b69a92cf8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:01.935067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 509/1013] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:47:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:02.003126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554beeec-f3e5-46de-a202-7426dcd73911 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.003637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554beeec-f3e5-46de-a202-7426dcd73911 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.003637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554beeec-f3e5-46de-a202-7426dcd73911 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.005309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 505/1014] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:02.011350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.011646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.011928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.029795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:02.031015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:02.113697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 510/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:02.138548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554beeec-f3e5-46de-a202-7426dcd73911 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:02.201229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:02.245968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554beeec-f3e5-46de-a202-7426dcd73911 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:02.280347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:02.281077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.281358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.281632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.292307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:02.300344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:02.301266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:02.302111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 506/1016] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 09:47:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:02.309228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:02.358535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:02.410076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01354fea-2bda-4eeb-bb96-77b02bbc7021 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:02.447214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:02.447877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.448195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.448476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.449218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:02.449526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:02.450888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:02.463402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 511/1017] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:47:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:02.464876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:02.566098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526653f-2707-42b0-84f7-2b3e1889dbf4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:02.584384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:02.602770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:02.603597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.603879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.604197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.616004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:02.617941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:02.635890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:02.636926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:02.637828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:02.637828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:02.637828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:02.637828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:02.640041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 507/1018] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:02.642807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:02.744739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6f3c-3e70-43a5-b53b-0fd770bf3a47 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:02.757125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:02.778704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:02.779361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.779645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.779922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.780663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:02.780973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:02.782337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:02.794522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 512/1019] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:02.799837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:02.898362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac7f3f-b669-4d10-979f-ddf598c15faa None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:02.931180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:02.931964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:02.932282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:02.932560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:02.940095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:02.941516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:47:02.955195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:02.956387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:47:02.957355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:02.961607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 508/1020] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:47:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:02.962575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:03.067594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccbf2d-3ca8-4d22-b0f1-c30a1354712b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:03.115318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:03.116041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.116327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.116603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.117441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:03.117751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:03.119169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:03.141879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 513/1021] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:47:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:03.143631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:03.175818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:03.246937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de354b67-48ee-4f98-ac5f-4aee0d246e68 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:03.280574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a149e-4c09-4a7c-b171-7c30c18721a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:03.281221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a149e-4c09-4a7c-b171-7c30c18721a1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.281505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a149e-4c09-4a7c-b171-7c30c18721a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.281784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a149e-4c09-4a7c-b171-7c30c18721a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.348444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a149e-4c09-4a7c-b171-7c30c18721a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:03.349894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a149e-4c09-4a7c-b171-7c30c18721a1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:03.379309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:03.450883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 509/1022] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:03 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:03.456804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:03.487279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:03.541524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df80d2-a456-4980-b024-66eed4ed8638 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.541852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df80d2-a456-4980-b024-66eed4ed8638 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.542081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df80d2-a456-4980-b024-66eed4ed8638 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.543715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 510/1023] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:47:03.548271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.548650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.549016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.559798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a6b7f-64ee-4feb-b37a-fd63888fa194 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:03.566172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:03.567348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:03.595413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:03.596240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.596527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.596807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.609391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:03.610834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:03.629855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:03.630778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:03.632295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:03.632295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:03.632295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:03.632295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:03.636319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 514/1024] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:03.637518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:03.638122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 511/1025] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:03 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:03.661012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:03.724140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:03.726661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:03.745423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ebc07-dd6e-4588-83a1-5a6362620a23 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:03.772284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9203621-39ba-4c10-9618-1acbde0f16cc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:03.782089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:03.783063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.783350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.783779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.784582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:03.784897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:03.786321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:03.798094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 515/1026] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:03.804120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:03.807548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:03.808246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.808526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.808801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.809512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:03.810863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:03.827213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 512/1027] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:47:03 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:47:03.916841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc764a3-1191-4a4d-a8b5-e94d44830944 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:03.958950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:03.959798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:03.960111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:03.960386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:03.967802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:03.969274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:03.971788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-08745b16-ce83-4ef7-b9bf-4a9af5536e9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:47:03.987609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:03.988529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:03.989424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 516/1028] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:03.995524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:04.011022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913de68d-836b-43af-b512-55db5dfa6b0e None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:04.011616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913de68d-836b-43af-b512-55db5dfa6b0e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:04.011903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913de68d-836b-43af-b512-55db5dfa6b0e None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:04.013325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 517/1029] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:04.019471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:04.019759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:04.020114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:04.037146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:04.039193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:04.107215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0950bc0-dd33-466b-8358-bf4198a0dd5b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:04.119153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 518/1030] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:04.129126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:04.141998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:04.145217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:04.145887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:04.146173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:04.146452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:04.147278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:04.147596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:04.149053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:04.166823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 513/1031] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:04.167847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:04.246803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b86a7-b4ea-43a8-bff6-b65eab44448f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:04.268738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fe22e-df18-42bd-90aa-cc9099778c06 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:04.273798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:04.283123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:04.284042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:04.284330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:04.284604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:04.285783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:04.287480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:04.289856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 519/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:04.295329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:04.304453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:04.305105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:04.305385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:04.305659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:04.306479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] RBAC: Adding query filter params (role.id=50a936dd8df743a5b1e5579c481e512a, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=947e9ae8d1a44654b3c294b849912707) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:04.306786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:04.308221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54196616-80f2-4162-9255-f7e84acc0f4e None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:04.324027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 514/1033] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:04 2022] GET /identity/v3/role_assignments?user.id=947e9ae8d1a44654b3c294b849912707&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=50a936dd8df743a5b1e5579c481e512a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:04.420269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d1b0a-1417-4659-832a-5179765f8634 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:04.455467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5dffb-ea59-48df-ae46-b05d5dd9ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:04.456241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5dffb-ea59-48df-ae46-b05d5dd9ebc2 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:04.456527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5dffb-ea59-48df-ae46-b05d5dd9ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:04.456802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5dffb-ea59-48df-ae46-b05d5dd9ebc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:04.457522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5dffb-ea59-48df-ae46-b05d5dd9ebc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:04.458967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5dffb-ea59-48df-ae46-b05d5dd9ebc2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:04.496185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 520/1034] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:47:04 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:05.898937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6c42-78de-4cce-bfb8-3a2069f6deb9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:05.899481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6c42-78de-4cce-bfb8-3a2069f6deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:05.899481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6c42-78de-4cce-bfb8-3a2069f6deb9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:05.900952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 515/1035] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:05.906173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:05.906587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:05.906764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:05.923761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:05.924964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:05.969593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:05.996022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 521/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:06.018563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6c42-78de-4cce-bfb8-3a2069f6deb9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.066768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:06.125464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6c42-78de-4cce-bfb8-3a2069f6deb9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.161043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.161776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.162055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.162327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] PATH_INFO: `/v3/services/image` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.163002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.164371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2fc1da69-83f7-4794-aaef-3ac9ce7c998d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:06.175917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:06.176939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:06.177867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:06.179394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 516/1037] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:06.183127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.284274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cb3bf-4b75-45ae-865f-440add1db478 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.317993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.318661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.319446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.319726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.320462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] RBAC: Adding query filter params (name=image) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:06.320772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.322202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.331797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 522/1038] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:06.332741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.333338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698d066-7591-4c79-9480-60240cbae7fd None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.333759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698d066-7591-4c79-9480-60240cbae7fd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.334043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698d066-7591-4c79-9480-60240cbae7fd None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.340013 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 517/1039] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:47:06.340946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76d64-761b-4b39-abff-5093369d404f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.341319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76d64-761b-4b39-abff-5093369d404f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.341665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c76d64-761b-4b39-abff-5093369d404f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.360161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-32c76d64-761b-4b39-abff-5093369d404f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:06.361777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-32c76d64-761b-4b39-abff-5093369d404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:06.383341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:06.442959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11557-5bdb-49ec-9616-294a7401b33f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.456073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 518/1040] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:06.476111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76d64-761b-4b39-abff-5093369d404f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.479174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.480623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.480914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.481192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.481904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] RBAC: Adding query filter params (type=image) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:06.482215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.483602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.494346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 523/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:06.495467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.520716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:06.580583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c76d64-761b-4b39-abff-5093369d404f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.597709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c03ccb-58f0-48a4-9598-6e5a8e1ff455 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.605701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:06.614970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843a1c6-4b2e-4b15-9115-11490644d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.615795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a1c6-4b2e-4b15-9115-11490644d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.616108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a1c6-4b2e-4b15-9115-11490644d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.616389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a1c6-4b2e-4b15-9115-11490644d6f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.626232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843a1c6-4b2e-4b15-9115-11490644d6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:06.632565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.633210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.633494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.633780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5843a1c6-4b2e-4b15-9115-11490644d6f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:06.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:06.635450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:47:06.636532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:06.637387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] RBAC: Adding query filter params (interface=public, service_id=e8a2f6551db345f9a8ffbc1c8c1ddd7f, region_id=RegionOne) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:06.637387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.637524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 519/1042] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:06.637594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f44a3b-9978-4e31-aece-5e7fd99011ec None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.637670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0544e2d-28ab-4d48-924f-6defd5054f1f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.637670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0544e2d-28ab-4d48-924f-6defd5054f1f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.637670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0544e2d-28ab-4d48-924f-6defd5054f1f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.638767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 520/1043] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:06.641306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0544e2d-28ab-4d48-924f-6defd5054f1f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.644501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 524/1044] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/endpoints?service_id=e8a2f6551db345f9a8ffbc1c8c1ddd7f&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:06.645729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.646022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.646298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.663322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:06.664558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:06.729572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 525/1045] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:06.740139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.742296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:06.748008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0544e2d-28ab-4d48-924f-6defd5054f1f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.784931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.785190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.785358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.785709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.786435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:06.786746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.788722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.797069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 521/1046] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:06.797937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.845482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:06.848718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75750848-84e3-4c18-aa98-6f08cdf1c9ff None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.885160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.885812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.886100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.886374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.887040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.888436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.894762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 526/1047] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:47:06.895527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.898472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55761935-9641-4ff9-ae97-a9f4961e88ff None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:06.940382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:06.942484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:06.942773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:06.943051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:06.945440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:06.947290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:06.954180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 522/1048] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:06.955109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:06.989065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:07.006135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2fd1-c002-4f6a-bdfb-6529cdf97054 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.042895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.043695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.044508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.044508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.058239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.059713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.076166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99750f-f36f-407c-801b-51bc47da1ec1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:07.080173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:07.081213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:07.082344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:07.082344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:07.082344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:07.082344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:07.082344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 527/1049] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:07.088295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:07.109437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:07.124956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.125702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.125990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.126266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.127000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.128455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.152650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 523/1050] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:47:06 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:07.200306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bac03-86f9-40c7-98b0-2142af615d8c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.238890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.239673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.239903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.240207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.241491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:07.241805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.243224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.255857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 528/1051] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:07.261987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:07.351547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:07.373396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe11f2-aa7a-4166-9b62-c7b3cb4d98fe None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.412462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.413294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.413574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.413849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.421450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.422882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:47:07.437188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:07.438136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:07.439077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 524/1052] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:47:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:07.444726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:07.523515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:07.547889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c5e0-f83d-4b7f-843e-27033189a4d2 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.581831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.582495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.582779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.583058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.583889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:07.584229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.585689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.603144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 529/1053] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:47:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:07.608560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:07.708417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb916-6e1f-449a-ace8-e6c616c63e33 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.741969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.742755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.743036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.743313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.753814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.755251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.757737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:07.773465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:07.774431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:07.775343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:07.775343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:07.775343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:07.775343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:07.780019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 525/1054] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:07.780451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:07.881793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b62bb-ddf1-4b0b-a937-fef5e7fb9306 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:07.915135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:07.915792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:07.916110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:07.916383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:07.917097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:07.917399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:07.918748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:07.920180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:07.935356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 530/1055] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:07.937672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:08.040420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d632e-79ea-4719-a1f3-9b38f3cc7f2c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:08.073149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:08.074230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:08.074512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:08.074786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:08.081336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:08.082760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:47:08.101099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:08.101983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:08.107442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 526/1056] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:08.108304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:08.209435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3561c-839d-4d3b-b4a1-10212176f177 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:08.243147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:08.243793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:08.244104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:08.244380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:08.245155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:08.245462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:08.246869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c6853-2470-408a-ab99-8fc3a477bf6e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:08.258800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 531/1057] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:47:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:08.264470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:08.325596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:08.370763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee39b-ac4f-443c-b59f-7efdc31e78bc None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:08.404792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f98f91-eafd-48e3-a6ed-60491ac5ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:08.405677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98f91-eafd-48e3-a6ed-60491ac5ffb3 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:08.405957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98f91-eafd-48e3-a6ed-60491ac5ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:08.406231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98f91-eafd-48e3-a6ed-60491ac5ffb3 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/947e9ae8d1a44654b3c294b849912707/roles/50a936dd8df743a5b1e5579c481e512a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:08.408409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98f91-eafd-48e3-a6ed-60491ac5ffb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=947e9ae8d1a44654b3c294b849912707, role_id=50a936dd8df743a5b1e5579c481e512a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:08.409831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f98f91-eafd-48e3-a6ed-60491ac5ffb3 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:08.424795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 527/1058] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:47:08 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/947e9ae8d1a44654b3c294b849912707/roles/50a936dd8df743a5b1e5579c481e512a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:47:08.968372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73677e-760d-4e0a-93a4-421e0b570de0 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:08.968744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73677e-760d-4e0a-93a4-421e0b570de0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:08.968941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73677e-760d-4e0a-93a4-421e0b570de0 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:08.970292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 532/1059] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:08.975831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:08.976260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:08.976610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:08.993900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:08.995066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:09.064020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 528/1060] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:09.086240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73677e-760d-4e0a-93a4-421e0b570de0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.148125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:09.196027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73677e-760d-4e0a-93a4-421e0b570de0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.230417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.231193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.231473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.231746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] PATH_INFO: `/v3/services/image` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.232425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:09.233781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e37ab4e9-2d7c-43cf-95ef-66656a077b6c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:09.245341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:09.246344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:09.247209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 533/1061] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:09.253932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.258570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917296-58aa-41fa-b2d1-e368b2555347 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.258866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917296-58aa-41fa-b2d1-e368b2555347 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.259148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b917296-58aa-41fa-b2d1-e368b2555347 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.260541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 534/1062] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:47:09.265834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.266567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.266966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.283809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:09.285022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:09.301786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:09.357530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 535/1063] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:09.360476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2756a-e3d6-451a-89b9-dd56cbe4ce44 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.381063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.399079 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.399736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.400039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.400321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.401015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:09.401318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:09.402664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:09.407719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 529/1064] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:09.412994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.434101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:09.489663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d8cd-87ca-4c2d-9831-c89e7fe57c0d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.520769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28ed92-9d12-4f89-bf9c-8997afd1ddd2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.527710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.528657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.528826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.529092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.532770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:09.540654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:09.548289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:09.549295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:09.550160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 536/1065] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:47:09.555886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.563711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.564436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.564832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.565228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.565942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] RBAC: Adding query filter params (type=image) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:09.566253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:09.567621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:09.577683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 530/1066] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:09.578636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.659103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25badfb-c69a-4571-889b-b6a1c00405e0 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.668689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:09.686689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2cf0a-42b8-4cc8-85ac-15963545872a None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.695807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.696497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.696831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.697109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.697848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:09.698158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:09.699519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:09.712544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 537/1067] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:09.713424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.723385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.724410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.724703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.724983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.726087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:09.727588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:09.746210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 531/1068] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:47:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:09.821614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb21c4-f802-48a4-b803-ffc96199c5ef None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:09.863394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:09.864316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:09.864597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:09.864873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] PATH_INFO: `/v3/users/44dcd111be5f4fb48848968b10aac4f3` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:09.880355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] RBAC: Authorizing `identity:get_user(user_id=44dcd111be5f4fb48848968b10aac4f3)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:09.882500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:09.884486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 538/1069] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/users/44dcd111be5f4fb48848968b10aac4f3 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:09.890086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:09.922187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:09.994218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815686-e952-4da5-990d-01cbd5ef48df None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:10.026455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:10.027030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.027315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.027593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.100793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:10.101807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:10.132616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:10.218786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 532/1070] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:10.219938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:10.246687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:10.326597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712908b4-f49f-4800-943c-b87a15df7782 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:10.361311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71392b-886d-4db9-92c9-f5cd544d7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:10.362164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71392b-886d-4db9-92c9-f5cd544d7f2f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.362442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71392b-886d-4db9-92c9-f5cd544d7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.362715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71392b-886d-4db9-92c9-f5cd544d7f2f None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.363874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71392b-886d-4db9-92c9-f5cd544d7f2f None admin] RBAC: Authorizing `identity:get_project(project_id=05213f1ae79c4a3294f4f75bce35c253)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:10.365317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71392b-886d-4db9-92c9-f5cd544d7f2f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:10.372107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 539/1071] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:10 2022] GET /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:10.373451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:10.459417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c0822-018a-419a-99a6-3a024806de74 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.460297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c0822-018a-419a-99a6-3a024806de74 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.460538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c0822-018a-419a-99a6-3a024806de74 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.462032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 540/1072] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:10.466720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.467005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.467280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.480195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58353d1b-ff87-4a1e-9e95-1ef52e8e6bed None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:10.485333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:10.486519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:10.510153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:10.517103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:10.517759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.518042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.518323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.519153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=05213f1ae79c4a3294f4f75bce35c253, user.id=44dcd111be5f4fb48848968b10aac4f3) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:10.519464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:10.520921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:10.527364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 533/1073] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:10 2022] GET /identity/v3/role_assignments?user.id=44dcd111be5f4fb48848968b10aac4f3&scope.project.id=05213f1ae79c4a3294f4f75bce35c253&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:10.561078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 541/1074] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:10.586093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:10.696176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e86b96-c0fa-4247-ab9a-e0c010d97cce None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:10.730138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:10.730951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.731236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.731513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.741718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:10.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:10.750904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:10.751752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 534/1075] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Jun 21 09:47:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:10.758294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:10.783120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:10.863677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383df3a-0e80-494a-8275-c90fa798eff2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:10.900400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:10.901206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:10.901709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:10.902022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:10.902789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:10.903099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:10.904526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:10.914297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 542/1076] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:47:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:10.919649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:10.978791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:11.024790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb91a9-ecc4-4f56-aa6c-2db1daf83cc1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:11.058884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:11.059669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.059950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.060258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.070857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:11.072307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:11.089773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:11.090692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:11.091684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:11.091684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:11.091684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:11.091684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:11.091684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 535/1077] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:11.101241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:11.188895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:11.205498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3679403-30f1-4901-a2cf-ba0d7321fbc3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:11.240040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:11.240753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.240998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.241274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.241990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:11.242301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:11.243648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:11.260221 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 543/1078] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:11.261369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:11.361074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf107f-2f51-4617-93f8-89ea5924fe01 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:11.368021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:11.395856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:11.396663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.396945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.397272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.408548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:11.409988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:47:11.423646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:11.424642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:11.425605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 536/1079] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Jun 21 09:47:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:11.432114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:11.533338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254c17e-21d1-4f8a-bafa-9d634ebc09c8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:11.566954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:11.567614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.567896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.568202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.569574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:11.569883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:11.571305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbb30e-ce62-4690-aa0d-11152d8e44a4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:11.593586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 544/1080] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Jun 21 09:47:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:11.595289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:11.697034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ff48a-8192-4c22-8486-c514afdbafe8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:11.742037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:11.742683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.742963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.743235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.777192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:11.811715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:11.813112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:11.831835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958795-0a0c-4fe2-beeb-c738e28bfdf3 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.832164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958795-0a0c-4fe2-beeb-c738e28bfdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.832439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49958795-0a0c-4fe2-beeb-c738e28bfdf3 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.833954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 545/1081] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:11.838520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:11.838806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:11.839079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:11.844204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:11.857304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:11.858476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:11.917547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 537/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:11.923568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:11.932548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 546/1083] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:11.954769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:11.990237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.028685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ff1-c5e8-41bf-9a30-8dfde32eca8b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.055689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46eb0c-a77f-4ee6-84c7-a6e1d1733382 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.065531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.066617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.067047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.067462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.079285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.080917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.084917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.091262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.091920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.092241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.092526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:12.107255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:12.108366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:12.109454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:12.109454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:12.109454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:12.109454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:12.111137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 538/1084] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:47:12.117196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.174951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.176746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.224833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffdcd2-c196-4a1b-a8cd-3dfefff4714b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.243913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.261383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.262126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.262409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.262685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.263400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:12.263706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.265094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.276439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 539/1085] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:12.281747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.292017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 547/1086] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 09:47:12.296394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.329219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.385424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b648d-52db-4a9d-b75a-b1c41a5c2252 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.401371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331ba16-811b-42ae-a9a1-016b028839ef None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.420601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.421386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.421668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.421939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.429287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.430720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.437327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.438110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.438390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.438660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:47:12.444864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:12.445746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:12.446723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 540/1087] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:47:12.451181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.451631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.452752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:12.471632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:12.472601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:12.473748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:47:12.473748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:12.473748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:47:12.473748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:12.478425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 548/1088] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:47:12.479474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.494937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.557098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3354968-c046-4a93-bea8-beb36e9d5570 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.570958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.587766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5376-38c6-4be1-b97f-1be064079c77 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.592792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.593452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.593730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.594002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.594783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:12.595089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.596537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb08c-08ce-4310-bdb5-1c31b169bc64 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.608492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 541/1089] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:12.609767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d31b-516c-4a95-a78e-5382fa073c9c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.610104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d31b-516c-4a95-a78e-5382fa073c9c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.610380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d31b-516c-4a95-a78e-5382fa073c9c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.611724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 542/1090] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:12.616574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d31b-516c-4a95-a78e-5382fa073c9c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.623253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.623913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.624248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.624526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.625657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:12.625969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.627704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559fdb5f-a116-4d74-8ddd-8a7947d5f43e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.639233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 549/1091] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:12.640437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.640726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.641007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.666715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:12.667967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:12.729750 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.734354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d31b-516c-4a95-a78e-5382fa073c9c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.745851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 550/1092] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:12.768919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:12.771291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.772500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.772796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.773069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.773910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] RBAC: Adding query filter params (role.id=50a936dd8df743a5b1e5579c481e512a, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=947e9ae8d1a44654b3c294b849912707) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:12.774220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:12.775711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:12.792016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 543/1093] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/role_assignments?user.id=947e9ae8d1a44654b3c294b849912707&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=50a936dd8df743a5b1e5579c481e512a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:12.858369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:12.887989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6faaa-5a47-47cf-9575-c4254e4a5331 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:12.926656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229375-3a37-41f7-995a-728409da872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:12.927474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229375-3a37-41f7-995a-728409da872c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:12.927754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229375-3a37-41f7-995a-728409da872c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:12.928067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56229375-3a37-41f7-995a-728409da872c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:12.939388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56229375-3a37-41f7-995a-728409da872c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-56229375-3a37-41f7-995a-728409da872c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:12.947578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:12.948766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:12.949772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 551/1094] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:47:12.956838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:13.057918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de51d-574c-405a-be90-cf0be8a73e10 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:13.091950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:13.092645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:13.092931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:13.093206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:13.093952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:13.094259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:13.095633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:13.105158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 544/1095] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:13.110687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229375-3a37-41f7-995a-728409da872c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:13.212818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56229375-3a37-41f7-995a-728409da872c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:13.247824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:13.248745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:13.249030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:13.249309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] PATH_INFO: `/v3/users/44dcd111be5f4fb48848968b10aac4f3` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:13.250508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] RBAC: Authorizing `identity:get_user(user_id=44dcd111be5f4fb48848968b10aac4f3)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:13.251939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:13.253612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 552/1096] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:13 2022] GET /identity/v3/users/44dcd111be5f4fb48848968b10aac4f3 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:13.259483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:13.287415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:13.363527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e9326-f6c8-40df-a2fa-86ff26b24be8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:13.399959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8e232-35ef-485d-8449-7c93b5495c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:13.400854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e232-35ef-485d-8449-7c93b5495c47 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:13.401138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e232-35ef-485d-8449-7c93b5495c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:13.401413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8e232-35ef-485d-8449-7c93b5495c47 None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:13.402591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8e232-35ef-485d-8449-7c93b5495c47 None admin] RBAC: Authorizing `identity:get_project(project_id=05213f1ae79c4a3294f4f75bce35c253)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:13.404084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8e232-35ef-485d-8449-7c93b5495c47 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:13.405798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 545/1097] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:13 2022] GET /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:13.411832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:13.415473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:13.516571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085a9eb-abcf-440a-beba-2289fcc55063 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:13.551217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6e222-f55a-45af-be3f-c1336cfa5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:13.552145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6e222-f55a-45af-be3f-c1336cfa5d08 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:13.552423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6e222-f55a-45af-be3f-c1336cfa5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:13.552692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6e222-f55a-45af-be3f-c1336cfa5d08 None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253/users/44dcd111be5f4fb48848968b10aac4f3/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:13.555173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6e222-f55a-45af-be3f-c1336cfa5d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=05213f1ae79c4a3294f4f75bce35c253, user_id=44dcd111be5f4fb48848968b10aac4f3, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:13.556707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6e222-f55a-45af-be3f-c1336cfa5d08 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:13.570066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 553/1098] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:47:13 2022] PUT /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253/users/44dcd111be5f4fb48848968b10aac4f3/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:47:15.572226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae886-1aec-4be8-98cd-bfd4fd683c30 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:15.572785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae886-1aec-4be8-98cd-bfd4fd683c30 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:15.572785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebae886-1aec-4be8-98cd-bfd4fd683c30 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:15.574137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 546/1099] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:15.579179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:15.579593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:15.579731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:15.596541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:15.597691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:15.651395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:15.662031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 554/1100] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:15.685746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae886-1aec-4be8-98cd-bfd4fd683c30 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:15.775247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:15.785287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebae886-1aec-4be8-98cd-bfd4fd683c30 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:15.817007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:15.817775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:15.818061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:15.818332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:15.829691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:15.838648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:15.839830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:15.840749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 547/1101] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:15.845810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:15.941120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b808467-9e79-4c7e-896a-e14527a4c7ed None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:15.974019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:15.974670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:15.974951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:15.975252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:15.976010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:15.976322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:15.977674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:15.985411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 555/1102] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:15.990786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:16.086761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e15ca-0682-4136-b4ef-4c0d6e4eebf3 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:16.119387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:16.120265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:16.120548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:16.120824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] PATH_INFO: `/v3/users/44dcd111be5f4fb48848968b10aac4f3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:16.121989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] RBAC: Authorizing `identity:get_user(user_id=44dcd111be5f4fb48848968b10aac4f3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:16.123396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:16.125039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 548/1103] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:15 2022] GET /identity/v3/users/44dcd111be5f4fb48848968b10aac4f3 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:16.130645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:16.183609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:16.226807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6ffab-979e-4d6b-a7eb-12473c0a9d0a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:16.259092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:16.259711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:16.260008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:16.260285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:16.323848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:16.325311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:16.375826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:16.418785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 556/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:16.424620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:16.446431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:16.522076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666e448-e6f2-4b56-873e-86657497caab None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:16.554147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80792-81ff-4ef0-b0a9-42c4a044851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:16.554979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80792-81ff-4ef0-b0a9-42c4a044851f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:16.555260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80792-81ff-4ef0-b0a9-42c4a044851f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:16.555533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80792-81ff-4ef0-b0a9-42c4a044851f None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:16.556714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80792-81ff-4ef0-b0a9-42c4a044851f None admin] RBAC: Authorizing `identity:get_project(project_id=05213f1ae79c4a3294f4f75bce35c253)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:16.558121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80792-81ff-4ef0-b0a9-42c4a044851f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:16.559787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 549/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:16 2022] GET /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:16.565663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:16.664584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8159f-ea48-4d2e-968b-3b69bf568aef None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:16.697274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:16.697909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:16.698189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:16.698460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:16.699274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=05213f1ae79c4a3294f4f75bce35c253, user.id=44dcd111be5f4fb48848968b10aac4f3) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:16.699581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:16.701027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09fad1f-f0f1-49b8-8798-a549d99f4469 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:16.706677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 557/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:16 2022] GET /identity/v3/role_assignments?user.id=44dcd111be5f4fb48848968b10aac4f3&scope.project.id=05213f1ae79c4a3294f4f75bce35c253&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:18.711806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24f86-0946-447e-a835-a21208c988d7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:18.712360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24f86-0946-447e-a835-a21208c988d7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:18.712449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24f86-0946-447e-a835-a21208c988d7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:18.713774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 550/1107] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:18.718823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:18.719215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:18.719366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:18.736465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:18.737630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:18.750111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:18.801449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 558/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:18.825435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24f86-0946-447e-a835-a21208c988d7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:18.911982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:18.924613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24f86-0946-447e-a835-a21208c988d7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:18.956833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1202d3-14d4-4c75-9253-9ed8857a16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:18.957602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1202d3-14d4-4c75-9253-9ed8857a16d7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:18.957886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1202d3-14d4-4c75-9253-9ed8857a16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:18.958163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1202d3-14d4-4c75-9253-9ed8857a16d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:18.959317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1202d3-14d4-4c75-9253-9ed8857a16d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:18.961363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1202d3-14d4-4c75-9253-9ed8857a16d7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:18.963004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 551/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:18.968509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:19.060745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfa817-692e-412a-bc7f-7d3d2282cb64 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:19.094366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f16ba-ebab-4c6c-9a80-62e6c6a6e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:19.095057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f16ba-ebab-4c6c-9a80-62e6c6a6e5e7 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:19.095338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f16ba-ebab-4c6c-9a80-62e6c6a6e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:19.095616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f16ba-ebab-4c6c-9a80-62e6c6a6e5e7 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:19.096354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f16ba-ebab-4c6c-9a80-62e6c6a6e5e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:19.097777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f16ba-ebab-4c6c-9a80-62e6c6a6e5e7 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:19.117771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 559/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:47:18 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:21.144807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8680f-261b-48a7-96e2-944f17ab3bbe None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:21.145271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8680f-261b-48a7-96e2-944f17ab3bbe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:21.145387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8680f-261b-48a7-96e2-944f17ab3bbe None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:21.146730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 552/1111] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:21.152308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:21.152718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:21.152859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:21.158744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:21.170203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:21.171368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:21.234925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 560/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:21.258127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8680f-261b-48a7-96e2-944f17ab3bbe None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:21.356126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8680f-261b-48a7-96e2-944f17ab3bbe None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:21.389128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:21.389963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:21.390244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:21.390521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] PATH_INFO: `/v3/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:21.391992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] RBAC: Authorizing `identity:get_role(role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:21.393672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:21.395032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 553/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:21 2022] GET /identity/v3/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:21.401252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:21.494406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a030fa2-a7b1-41c8-9ab6-6627906c5f84 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:21.526603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:21.527448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:21.527727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:21.528023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] PATH_INFO: `/v3/users/d3cbc9318d4f4bc0bd97171553929aa6` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:21.529853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:21.541689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] RBAC: Authorizing `identity:get_user(user_id=d3cbc9318d4f4bc0bd97171553929aa6)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:21.543105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:21.544747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 561/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:21 2022] GET /identity/v3/users/d3cbc9318d4f4bc0bd97171553929aa6 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:21.550306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:21.575353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:21.646240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05f122-88a9-4b2e-beeb-6f734d451f54 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:21.677998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:21.679125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:21.679410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:21.679686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:21.743319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:21.744770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:21.769705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:21.848964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 554/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:21.854842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:21.949528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab8500-f482-46a3-855c-e27eb99f1a5c None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:21.981817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851fe48-d9b9-42bf-9e6e-d70b9b593c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:21.982650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851fe48-d9b9-42bf-9e6e-d70b9b593c37 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:21.982932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851fe48-d9b9-42bf-9e6e-d70b9b593c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:21.983208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851fe48-d9b9-42bf-9e6e-d70b9b593c37 None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:21.984392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851fe48-d9b9-42bf-9e6e-d70b9b593c37 None admin] RBAC: Authorizing `identity:get_project(project_id=05213f1ae79c4a3294f4f75bce35c253)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:21.985821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851fe48-d9b9-42bf-9e6e-d70b9b593c37 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:21.987474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 562/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:21 2022] GET /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:21.993887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:22.087338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40deca-1274-4fcd-aa32-90f463720084 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:22.113082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:22.127084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:22.127737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:22.128047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:22.128326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:22.129154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] RBAC: Adding query filter params (role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=05213f1ae79c4a3294f4f75bce35c253, user.id=d3cbc9318d4f4bc0bd97171553929aa6) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:22.129463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:22.130883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c16b6-63ed-44ca-bc54-2f119019dde7 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:22.136265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 555/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:21 2022] GET /identity/v3/role_assignments?user.id=d3cbc9318d4f4bc0bd97171553929aa6&scope.project.id=05213f1ae79c4a3294f4f75bce35c253&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:24.124872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a0744-179e-4ff5-ae83-f55573f5bfaa None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:24.125443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a0744-179e-4ff5-ae83-f55573f5bfaa None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:24.125443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43a0744-179e-4ff5-ae83-f55573f5bfaa None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:24.126773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 563/1118] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:24.132709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:24.133163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:24.133263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:24.149571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:24.150737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:24.214878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 556/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:24.237588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a0744-179e-4ff5-ae83-f55573f5bfaa None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:24.295590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:24.335486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43a0744-179e-4ff5-ae83-f55573f5bfaa None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:24.368910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:24.369680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:24.369964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:24.370240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] PATH_INFO: `/v3/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:24.371683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] RBAC: Authorizing `identity:get_role(role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:24.373073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:24.374407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 564/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:24 2022] GET /identity/v3/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:24.380140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:24.473664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62680013-ebab-4975-932f-c3b8c895fec4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:24.490310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:24.507277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:24.508156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:24.508436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:24.508710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] PATH_INFO: `/v3/users/d3cbc9318d4f4bc0bd97171553929aa6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:24.509867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] RBAC: Authorizing `identity:get_user(user_id=d3cbc9318d4f4bc0bd97171553929aa6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:24.511273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:24.512899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 557/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:24 2022] GET /identity/v3/users/d3cbc9318d4f4bc0bd97171553929aa6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:24.518492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:24.614004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159ad46-6195-4d0c-ae37-4c580c55cf12 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:24.638617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:24.646203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962e207-8458-4d6e-b7ce-5ebf7c69c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:24.647539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e207-8458-4d6e-b7ce-5ebf7c69c9ef None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:24.647819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e207-8458-4d6e-b7ce-5ebf7c69c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:24.648124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962e207-8458-4d6e-b7ce-5ebf7c69c9ef None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:24.649285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962e207-8458-4d6e-b7ce-5ebf7c69c9ef None admin] RBAC: Authorizing `identity:get_project(project_id=05213f1ae79c4a3294f4f75bce35c253)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:24.650692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962e207-8458-4d6e-b7ce-5ebf7c69c9ef None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:24.652383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 565/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:24 2022] GET /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:24.658082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:24.752156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7626-25fa-4d49-aab5-978d9eca2813 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:24.784093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512f0ca-bc4d-43a7-9370-95d9f1c08e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:24.784952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512f0ca-bc4d-43a7-9370-95d9f1c08e61 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:24.785231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512f0ca-bc4d-43a7-9370-95d9f1c08e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:24.785503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512f0ca-bc4d-43a7-9370-95d9f1c08e61 None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253/users/d3cbc9318d4f4bc0bd97171553929aa6/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:24.788271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512f0ca-bc4d-43a7-9370-95d9f1c08e61 None admin] RBAC: Authorizing `identity:create_grant(project_id=05213f1ae79c4a3294f4f75bce35c253, user_id=d3cbc9318d4f4bc0bd97171553929aa6, role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:24.789670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512f0ca-bc4d-43a7-9370-95d9f1c08e61 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:24.801793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 558/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:47:24 2022] PUT /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253/users/d3cbc9318d4f4bc0bd97171553929aa6/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:47:26.791965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2f7a-6a0a-4e9f-9017-ab2430cca8cb None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:26.792509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2f7a-6a0a-4e9f-9017-ab2430cca8cb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:26.792614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2f7a-6a0a-4e9f-9017-ab2430cca8cb None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:26.793934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 566/1124] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:26.799085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:26.799475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:26.799630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:26.816353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:26.817508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:26.857886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:26.883942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 559/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:26.907396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2f7a-6a0a-4e9f-9017-ab2430cca8cb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:27.006863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2f7a-6a0a-4e9f-9017-ab2430cca8cb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:27.038685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:27.039514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:27.039798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:27.040105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] PATH_INFO: `/v3/roles/92c6e9329fb54f278d53c7c8049fd2ec` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:27.041578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] RBAC: Authorizing `identity:get_role(role_id=92c6e9329fb54f278d53c7c8049fd2ec)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:27.042991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:27.044317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 567/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:26 2022] GET /identity/v3/roles/92c6e9329fb54f278d53c7c8049fd2ec => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:27.050113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:27.145631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d7444-6470-4e92-8980-f278bdab516a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:27.192305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:27.193178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:27.193463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:27.193772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] PATH_INFO: `/v3/users/d3cbc9318d4f4bc0bd97171553929aa6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:27.195076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] RBAC: Authorizing `identity:get_user(user_id=d3cbc9318d4f4bc0bd97171553929aa6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:27.197568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:27.200052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 560/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:27 2022] GET /identity/v3/users/d3cbc9318d4f4bc0bd97171553929aa6 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:27.205908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:27.266153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:27.302100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad6f8-37cf-4907-89ea-be2c99869c51 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:27.334115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:27.334741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:27.335022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:27.335295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:27.399375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:27.400840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:27.457829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:27.497110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 568/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:27.503086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:27.547240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:27.599115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7a8d4-01be-4e67-a348-997933b5b5ad None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:27.632156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6cf2e-2f8f-4ac6-ac77-9f7991e957e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:27.632997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6cf2e-2f8f-4ac6-ac77-9f7991e957e8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:27.633276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6cf2e-2f8f-4ac6-ac77-9f7991e957e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:27.633549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6cf2e-2f8f-4ac6-ac77-9f7991e957e8 None admin] PATH_INFO: `/v3/projects/05213f1ae79c4a3294f4f75bce35c253` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:27.634720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6cf2e-2f8f-4ac6-ac77-9f7991e957e8 None admin] RBAC: Authorizing `identity:get_project(project_id=05213f1ae79c4a3294f4f75bce35c253)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:27.636160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6cf2e-2f8f-4ac6-ac77-9f7991e957e8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:27.637807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 561/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:27 2022] GET /identity/v3/projects/05213f1ae79c4a3294f4f75bce35c253 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:27.643738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:27.738159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e4079-ed03-48f8-84f1-7eccbe923fec None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:27.769721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:27.770354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:27.770636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:27.770911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:27.772257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] RBAC: Adding query filter params (role.id=92c6e9329fb54f278d53c7c8049fd2ec, scope.project.id=05213f1ae79c4a3294f4f75bce35c253, user.id=d3cbc9318d4f4bc0bd97171553929aa6) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:27.772586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:27.773999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce691a-fb94-4172-b878-ecc84630d0b3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:27.779573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 569/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:27 2022] GET /identity/v3/role_assignments?user.id=d3cbc9318d4f4bc0bd97171553929aa6&scope.project.id=05213f1ae79c4a3294f4f75bce35c253&role.id=92c6e9329fb54f278d53c7c8049fd2ec => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:29.772168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dfc4b-d658-4bac-a30a-1c4c835bb459 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:29.772694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dfc4b-d658-4bac-a30a-1c4c835bb459 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:29.772694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482dfc4b-d658-4bac-a30a-1c4c835bb459 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:29.774075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 562/1131] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:29.779238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:29.779678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:29.779808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:29.796417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:29.797611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:29.820683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:29.863563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 570/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:29.887605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dfc4b-d658-4bac-a30a-1c4c835bb459 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:29.984157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482dfc4b-d658-4bac-a30a-1c4c835bb459 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:29.997081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:30.017885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce473e0e-63db-44cf-a030-673875752832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:30.018659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473e0e-63db-44cf-a030-673875752832 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:30.018946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473e0e-63db-44cf-a030-673875752832 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:30.019222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473e0e-63db-44cf-a030-673875752832 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:30.020406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce473e0e-63db-44cf-a030-673875752832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:30.021846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce473e0e-63db-44cf-a030-673875752832 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:30.023499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 563/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:30.029058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:30.124495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cedba10-4c57-40de-bd76-b0cb715652eb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:30.157516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936af77-e5b1-48d6-ae95-fbf3f553d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:30.158164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936af77-e5b1-48d6-ae95-fbf3f553d9ad None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:30.158445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936af77-e5b1-48d6-ae95-fbf3f553d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:30.158721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936af77-e5b1-48d6-ae95-fbf3f553d9ad None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:30.159426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936af77-e5b1-48d6-ae95-fbf3f553d9ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:30.160875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936af77-e5b1-48d6-ae95-fbf3f553d9ad None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:30.185823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 571/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:47:30 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:32.197279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9755-9b87-4b68-9edd-e9eb8511c316 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:32.197813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9755-9b87-4b68-9edd-e9eb8511c316 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:32.197813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d9755-9b87-4b68-9edd-e9eb8511c316 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:32.199186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 564/1135] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:32.204228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:32.204602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:32.204789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:32.221095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:32.222266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:32.225200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:32.287636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 572/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:32.311723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9755-9b87-4b68-9edd-e9eb8511c316 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:32.407754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d9755-9b87-4b68-9edd-e9eb8511c316 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:32.440128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd22eb-4aa3-4c42-9c0b-af9c8eca916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:32.440891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd22eb-4aa3-4c42-9c0b-af9c8eca916d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:32.441174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd22eb-4aa3-4c42-9c0b-af9c8eca916d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:32.441442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd22eb-4aa3-4c42-9c0b-af9c8eca916d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:32.442590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd22eb-4aa3-4c42-9c0b-af9c8eca916d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:32.444049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd22eb-4aa3-4c42-9c0b-af9c8eca916d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:32.445618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 565/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:47:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:32.451185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:32.545971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932337f4-c85d-468f-a4f5-4f73e3262728 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:32.578893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ce3d-19ca-4e0d-b052-0b59ae12016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:32.579544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ce3d-19ca-4e0d-b052-0b59ae12016c None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:32.579826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ce3d-19ca-4e0d-b052-0b59ae12016c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:32.580134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ce3d-19ca-4e0d-b052-0b59ae12016c None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:32.580831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ce3d-19ca-4e0d-b052-0b59ae12016c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:32.582233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ce3d-19ca-4e0d-b052-0b59ae12016c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:32.591468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:32.603074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 573/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:47:32 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:34.696246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8b01-b95d-4e1d-b0c6-f6d6d16b64c7 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:34.696796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8b01-b95d-4e1d-b0c6-f6d6d16b64c7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:34.696796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e8b01-b95d-4e1d-b0c6-f6d6d16b64c7 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:34.698155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 566/1139] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:34.703336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346720-db31-473f-8984-8465f93a2e2c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:34.703719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346720-db31-473f-8984-8465f93a2e2c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:34.703897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10346720-db31-473f-8984-8465f93a2e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:34.720864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-10346720-db31-473f-8984-8465f93a2e2c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:34.722036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-10346720-db31-473f-8984-8465f93a2e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:34.785951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 574/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:34.808937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8b01-b95d-4e1d-b0c6-f6d6d16b64c7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:34.863604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:34.913006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e8b01-b95d-4e1d-b0c6-f6d6d16b64c7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:34.944994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:34.945759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:34.946038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:34.946357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:34.955877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:34.964033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:34.965213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:34.966155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 567/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:34.971222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10346720-db31-473f-8984-8465f93a2e2c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:35.065161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10346720-db31-473f-8984-8465f93a2e2c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:35.090239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:35.099319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:35.100586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:35.100872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:35.101150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:35.101895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:35.102201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:35.103563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:35.111626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 575/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:35.117342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:35.213371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ea30-4631-499f-b994-512f90a6e962 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:35.226930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:35.251537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:35.252458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:35.252739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:35.253015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] PATH_INFO: `/v3/users/8e1689620edb4979a4693dfc9d787fb6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:35.265853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] RBAC: Authorizing `identity:get_user(user_id=8e1689620edb4979a4693dfc9d787fb6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:35.267274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:35.268945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 568/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:35 2022] GET /identity/v3/users/8e1689620edb4979a4693dfc9d787fb6 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:35.275229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:35.370838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899962e4-021c-4770-868e-19d8e8cc08d2 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:35.403749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:35.404411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:35.404697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:35.404975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:35.457281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:35.469964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:35.471342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:35.565085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 576/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:35.571444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:35.665599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4da99b-85a3-4f2f-b07d-fdaecf0a8033 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:35.697526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b5c9-977d-4375-b6c7-23877b8f5588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:35.698357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b5c9-977d-4375-b6c7-23877b8f5588 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:35.698636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b5c9-977d-4375-b6c7-23877b8f5588 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:35.698910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b5c9-977d-4375-b6c7-23877b8f5588 None admin] PATH_INFO: `/v3/projects/91af064770c44ceda9feff82228fb977` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:35.700082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88b5c9-977d-4375-b6c7-23877b8f5588 None admin] RBAC: Authorizing `identity:get_project(project_id=91af064770c44ceda9feff82228fb977)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:35.701490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88b5c9-977d-4375-b6c7-23877b8f5588 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:35.703138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 569/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:35 2022] GET /identity/v3/projects/91af064770c44ceda9feff82228fb977 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:35.708969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:35.791281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:35.803427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e63538-d842-47d0-b5a3-327e27de771e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:35.835503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:35.836167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:35.836447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:35.836719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:35.837533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=91af064770c44ceda9feff82228fb977, user.id=8e1689620edb4979a4693dfc9d787fb6) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:35.837839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:35.839236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41635841-7e3d-49d1-b33b-76a1f5054ac8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:35.844431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 577/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:35 2022] GET /identity/v3/role_assignments?user.id=8e1689620edb4979a4693dfc9d787fb6&scope.project.id=91af064770c44ceda9feff82228fb977&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:37.823035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034d11-1268-44ab-a6ad-4b83a0080a29 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:37.823569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034d11-1268-44ab-a6ad-4b83a0080a29 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:37.823569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034d11-1268-44ab-a6ad-4b83a0080a29 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:37.825002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 570/1147] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:37.830477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:37.830930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:37.831021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:37.847991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:37.849410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:37.912794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 578/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:37.934874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034d11-1268-44ab-a6ad-4b83a0080a29 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:37.969177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:38.033627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034d11-1268-44ab-a6ad-4b83a0080a29 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:38.065550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:38.066312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:38.066593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:38.066866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:38.077131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:38.084556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:38.085622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:38.086655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 571/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:38.091707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:38.167983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:38.185674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7d6b9-d0b0-4bd9-9f2f-cd3fd896d711 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:38.217690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:38.218334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:38.218621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:38.218893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:38.219622 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:38.219926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:38.221298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:38.229280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 579/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:38.234937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:38.325842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:38.332855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b678-de3e-4c5c-a265-6699d0ab3bf1 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:38.364921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:38.366284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:38.366566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:38.366841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] PATH_INFO: `/v3/users/8e1689620edb4979a4693dfc9d787fb6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:38.368036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8e1689620edb4979a4693dfc9d787fb6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:38.369463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:38.371085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 572/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:38 2022] GET /identity/v3/users/8e1689620edb4979a4693dfc9d787fb6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:38.376690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:38.471565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6044f-81eb-46d3-946e-aa7eb241dfb8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:38.503986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e708b-7cd9-4acc-89fe-7d8ef819927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:38.504834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e708b-7cd9-4acc-89fe-7d8ef819927c None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:38.505110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e708b-7cd9-4acc-89fe-7d8ef819927c None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:38.505377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e708b-7cd9-4acc-89fe-7d8ef819927c None admin] PATH_INFO: `/v3/projects/91af064770c44ceda9feff82228fb977` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:38.506553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e708b-7cd9-4acc-89fe-7d8ef819927c None admin] RBAC: Authorizing `identity:get_project(project_id=91af064770c44ceda9feff82228fb977)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:38.507955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e708b-7cd9-4acc-89fe-7d8ef819927c None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:38.509620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 580/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:38 2022] GET /identity/v3/projects/91af064770c44ceda9feff82228fb977 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:38.515341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:38.612391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1c434-00ae-407e-8680-42b07bcdc1b6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:38.643901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a494d-0ec9-4d46-8c3f-be75f848b0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:38.644795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a494d-0ec9-4d46-8c3f-be75f848b0ee None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:38.645075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a494d-0ec9-4d46-8c3f-be75f848b0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:38.645348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a494d-0ec9-4d46-8c3f-be75f848b0ee None admin] PATH_INFO: `/v3/projects/91af064770c44ceda9feff82228fb977/users/8e1689620edb4979a4693dfc9d787fb6/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:38.647266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a494d-0ec9-4d46-8c3f-be75f848b0ee None admin] RBAC: Authorizing `identity:create_grant(project_id=91af064770c44ceda9feff82228fb977, user_id=8e1689620edb4979a4693dfc9d787fb6, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:38.648704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a494d-0ec9-4d46-8c3f-be75f848b0ee None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:38.661747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 573/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:47:38 2022] PUT /identity/v3/projects/91af064770c44ceda9feff82228fb977/users/8e1689620edb4979a4693dfc9d787fb6/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:47:40.632718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5edd2-4d65-475a-8a7f-ee30c324f654 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:40.633263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5edd2-4d65-475a-8a7f-ee30c324f654 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:40.633263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5edd2-4d65-475a-8a7f-ee30c324f654 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:40.634616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 581/1154] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:40.639717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:40.640115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:40.640308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:40.657149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:40.658321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:40.674260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:40.722713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 574/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:40.745904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5edd2-4d65-475a-8a7f-ee30c324f654 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:40.761112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:40.845926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5edd2-4d65-475a-8a7f-ee30c324f654 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:40.879472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:40.880276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:40.880559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:40.880835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:40.891270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:40.899454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:40.900580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:40.901464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 582/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:40.906771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:40.999488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b25a5-c817-47b9-9328-677facfba7c6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:41.031401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:41.032078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:41.032359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:41.032631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:41.033366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:41.033677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:41.035020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:41.042709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 575/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:41.048247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:41.116751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:41.147050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3484ce-47be-4fad-897a-db3ef7a9da5a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:41.179347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:41.180236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:41.180516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:41.180789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] PATH_INFO: `/v3/users/8e1689620edb4979a4693dfc9d787fb6` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:41.181948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] RBAC: Authorizing `identity:get_user(user_id=8e1689620edb4979a4693dfc9d787fb6)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:41.183361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:41.185006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 583/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:41 2022] GET /identity/v3/users/8e1689620edb4979a4693dfc9d787fb6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:41.190780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:41.206906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:41.286985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281c738-e524-42d3-a6bf-ace8bcee277b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:41.319615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:41.320270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:41.320556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:41.320831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:41.386619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:41.388071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:41.401564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:41.482056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 576/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:41.488220 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:41.583736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6be3cd-d91f-4f87-ac1e-918821ded25a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:41.616415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb670899-4524-482d-8420-e021539f5245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:41.617248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb670899-4524-482d-8420-e021539f5245 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:41.617528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb670899-4524-482d-8420-e021539f5245 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:41.617800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb670899-4524-482d-8420-e021539f5245 None admin] PATH_INFO: `/v3/projects/91af064770c44ceda9feff82228fb977` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:41.618957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb670899-4524-482d-8420-e021539f5245 None admin] RBAC: Authorizing `identity:get_project(project_id=91af064770c44ceda9feff82228fb977)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:41.620405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb670899-4524-482d-8420-e021539f5245 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:41.622059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 584/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:41 2022] GET /identity/v3/projects/91af064770c44ceda9feff82228fb977 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:41.627921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:41.721297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3d01f-66ef-473a-82ac-5e3bc15966d2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:41.735139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:41.755042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:41.755678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:41.755958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:41.756258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:41.757076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=91af064770c44ceda9feff82228fb977, user.id=8e1689620edb4979a4693dfc9d787fb6) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:41.757384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:41.758786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6f83f-8074-4e68-9d82-2529dc2cbac2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:41.764407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 577/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:41 2022] GET /identity/v3/role_assignments?user.id=8e1689620edb4979a4693dfc9d787fb6&scope.project.id=91af064770c44ceda9feff82228fb977&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:43.782765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859037d-db0d-49d5-ad69-773555f14e79 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:43.783320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859037d-db0d-49d5-ad69-773555f14e79 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:43.783320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859037d-db0d-49d5-ad69-773555f14e79 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:43.784713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 585/1162] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:43.789984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:43.790354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:43.790535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:43.806710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:43.807868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:43.871902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 578/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:43.894217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859037d-db0d-49d5-ad69-773555f14e79 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:43.905945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:43.992440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859037d-db0d-49d5-ad69-773555f14e79 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:44.024675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:44.025304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:44.025588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:44.025867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:44.089588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:44.090973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:44.101514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:44.185814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 586/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:47:44.192065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:44.286451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26543c-a54a-4920-95d3-37683a7c92a1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:44.295853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:44.319734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:44.320548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:44.320828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:44.321102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:44.327530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:44.329005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-eb27f94d-5872-404a-8892-b417a556533a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:44.343244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:44.344514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:44.345405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 579/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:47:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:44.351330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:44.445340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee9dbb-26db-4009-a5ea-a0a6d65ed4d5 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:44.454713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:44.479247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:44.479887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:44.480200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:44.480474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:44.481183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:44.481486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:44.482834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c002-3c64-4fee-a7de-59cb2c5a823e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:44.489665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 587/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Jun 21 09:47:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:46.476711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b447e-57db-4fd5-b21c-b0c5194e6a3f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:46.477213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b447e-57db-4fd5-b21c-b0c5194e6a3f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:46.477302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b447e-57db-4fd5-b21c-b0c5194e6a3f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:46.478639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 580/1167] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:46.484660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e27c6-25a2-45ae-ae06-a088f9cbd661 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:46.485091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e27c6-25a2-45ae-ae06-a088f9cbd661 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:46.485217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e27c6-25a2-45ae-ae06-a088f9cbd661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:46.501951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2d6e27c6-25a2-45ae-ae06-a088f9cbd661 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:46.503121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2d6e27c6-25a2-45ae-ae06-a088f9cbd661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:46.565627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 588/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:46.588468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b447e-57db-4fd5-b21c-b0c5194e6a3f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:46.686545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b447e-57db-4fd5-b21c-b0c5194e6a3f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:46.717840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d1222-7d46-497d-aebb-61923d3f0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:46.718477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d1222-7d46-497d-aebb-61923d3f0ffa None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:46.718765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d1222-7d46-497d-aebb-61923d3f0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:46.719045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d1222-7d46-497d-aebb-61923d3f0ffa None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:46.719799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d1222-7d46-497d-aebb-61923d3f0ffa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:46.721190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d1222-7d46-497d-aebb-61923d3f0ffa None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:46.735881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 581/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue Jun 21 09:47:46 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:48.770872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dab0a-8c13-481c-ac13-2092e5c7bbb2 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:48.771417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dab0a-8c13-481c-ac13-2092e5c7bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:48.771417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dab0a-8c13-481c-ac13-2092e5c7bbb2 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:48.772878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 589/1170] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:48.778025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:48.778406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:48.778586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:48.797420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:48.798606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:48.828213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:48.871808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 582/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:48.895761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dab0a-8c13-481c-ac13-2092e5c7bbb2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:48.992381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dab0a-8c13-481c-ac13-2092e5c7bbb2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:48.993834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:49.025388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c35eba-fabb-440b-b67e-11d4aa48ce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:49.026198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35eba-fabb-440b-b67e-11d4aa48ce29 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:49.026463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35eba-fabb-440b-b67e-11d4aa48ce29 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:49.026738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35eba-fabb-440b-b67e-11d4aa48ce29 None admin] PATH_INFO: `/v3/domains/83f3a0662b604a468b1623a315adf8d0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:49.036851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35eba-fabb-440b-b67e-11d4aa48ce29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=83f3a0662b604a468b1623a315adf8d0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:49.038789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35eba-fabb-440b-b67e-11d4aa48ce29 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:49.040438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 590/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jun 21 09:47:48 2022] GET /identity/v3/domains/83f3a0662b604a468b1623a315adf8d0 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:49.046320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:49.141139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f786dc-707e-4a2c-bba1-a134fed2e5d0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:49.173173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cc9ba-d011-44f4-b183-1fed12b5a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:49.173817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc9ba-d011-44f4-b183-1fed12b5a70d None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:49.174096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc9ba-d011-44f4-b183-1fed12b5a70d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:49.174368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc9ba-d011-44f4-b183-1fed12b5a70d None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:49.175059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc9ba-d011-44f4-b183-1fed12b5a70d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:49.176513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc9ba-d011-44f4-b183-1fed12b5a70d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:49.200304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 583/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:47:49 2022] POST /identity/v3/projects => generated 361 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:51.233875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd428d-4521-44bd-be90-3b72bdf58240 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:51.234411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd428d-4521-44bd-be90-3b72bdf58240 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:51.234411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd428d-4521-44bd-be90-3b72bdf58240 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:51.235792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 591/1174] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:51.241235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:51.241625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:51.241807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:51.258612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:51.259791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:51.262512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:51.325044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 584/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:51.350965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd428d-4521-44bd-be90-3b72bdf58240 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:51.447386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd428d-4521-44bd-be90-3b72bdf58240 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:51.482554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575919-28e9-45ec-9b43-997f83996cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:51.483403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575919-28e9-45ec-9b43-997f83996cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:51.483683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575919-28e9-45ec-9b43-997f83996cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:51.483955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575919-28e9-45ec-9b43-997f83996cb8 None admin] PATH_INFO: `/v3/domains/83f3a0662b604a468b1623a315adf8d0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:51.485149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575919-28e9-45ec-9b43-997f83996cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=83f3a0662b604a468b1623a315adf8d0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:51.486569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575919-28e9-45ec-9b43-997f83996cb8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:51.488200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 592/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Jun 21 09:47:51 2022] GET /identity/v3/domains/83f3a0662b604a468b1623a315adf8d0 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:51.494559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:51.589631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5dd872-7148-4590-9788-a9ce8dd48de7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:51.622069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898fb7c-94d0-4c4a-94cf-573b362be2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:51.622668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898fb7c-94d0-4c4a-94cf-573b362be2a0 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:51.622951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898fb7c-94d0-4c4a-94cf-573b362be2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:51.623228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898fb7c-94d0-4c4a-94cf-573b362be2a0 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:51.623926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898fb7c-94d0-4c4a-94cf-573b362be2a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:51.625367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898fb7c-94d0-4c4a-94cf-573b362be2a0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:51.635156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:51.645922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 585/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:47:51 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:47:53.680867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b0a37-5e34-4e65-a406-d4d5af5c143d None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:53.681393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b0a37-5e34-4e65-a406-d4d5af5c143d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:53.681393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b0a37-5e34-4e65-a406-d4d5af5c143d None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:53.682786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 593/1178] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:53.687797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:53.688218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:53.688388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:53.704989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:53.706163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:53.770323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 586/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:47:53.793886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b0a37-5e34-4e65-a406-d4d5af5c143d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:53.822686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:53.891387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b0a37-5e34-4e65-a406-d4d5af5c143d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:53.923979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:53.924759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:53.925046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:53.925321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:53.935127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:53.942708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:53.943775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:53.944691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 594/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:53.949764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:54.043957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d579e-b8e5-4c6d-93ba-33830b1d8901 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:54.069129 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:54.078229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:54.078968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:54.079321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:54.079667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:54.080523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:54.080897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:54.082321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:54.096303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 587/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:54.097525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:54.188999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:54.199518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba77c3-3f10-4351-b88f-f31b5d85dea4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:54.233661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:54.234537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:54.234818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:54.235095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] PATH_INFO: `/v3/users/82f73744fafd4ecc84a66e7ed0c445f9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:54.249037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] RBAC: Authorizing `identity:get_user(user_id=82f73744fafd4ecc84a66e7ed0c445f9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:54.250473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:54.252178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 595/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:54 2022] GET /identity/v3/users/82f73744fafd4ecc84a66e7ed0c445f9 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:54.258521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:54.356822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2217b1d-8947-4071-aeae-246fa867c195 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:54.388974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:54.389611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:54.389898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:54.390176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:54.442214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:54.454945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:54.456416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:54.572525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 588/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:47:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 09:47:54.578410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:54.672334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec17df6-c563-4482-9560-03207b292b01 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:54.704894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ea52-4223-4347-bfe6-9e663280c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:54.705670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ea52-4223-4347-bfe6-9e663280c39d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:54.705944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ea52-4223-4347-bfe6-9e663280c39d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:54.706211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ea52-4223-4347-bfe6-9e663280c39d None admin] PATH_INFO: `/v3/projects/322bc726f4f04da4934e9e892c6e6816` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:54.707356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8ea52-4223-4347-bfe6-9e663280c39d None admin] RBAC: Authorizing `identity:get_project(project_id=322bc726f4f04da4934e9e892c6e6816)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:54.708795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8ea52-4223-4347-bfe6-9e663280c39d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:54.710468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 596/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:54 2022] GET /identity/v3/projects/322bc726f4f04da4934e9e892c6e6816 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:54.716376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:54.798571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:54.810968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bb741-1c91-4661-ba09-5d18ea9c9523 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:54.843399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:54.844072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:54.844353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:54.844628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:54.845457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=322bc726f4f04da4934e9e892c6e6816, user.id=82f73744fafd4ecc84a66e7ed0c445f9) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:54.845766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:54.847189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef4db3-25e6-4be6-9671-ac3abccd169a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:54.853232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 589/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:47:54 2022] GET /identity/v3/role_assignments?user.id=82f73744fafd4ecc84a66e7ed0c445f9&scope.project.id=322bc726f4f04da4934e9e892c6e6816&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:47:56.823444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb312-874e-4ab3-a827-6ba363b0f474 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:56.824001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb312-874e-4ab3-a827-6ba363b0f474 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:56.824001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb312-874e-4ab3-a827-6ba363b0f474 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:56.825386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 597/1186] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:56.830448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:56.830852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:56.831003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:56.847154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:56.848332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:56.911353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 590/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:56.933395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bb312-874e-4ab3-a827-6ba363b0f474 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:56.951557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:57.031065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4bb312-874e-4ab3-a827-6ba363b0f474 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:57.063388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:57.064186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:57.064464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:57.064737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:57.075148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:57.082634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:57.083792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:47:57.085072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 598/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:57.089788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:57.166864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:57.184888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbee61-011e-4590-9e13-d6e85f2190fb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:57.216674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:57.217321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:57.217604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:57.217880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:57.218612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:47:57.218918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:57.220295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:57.228791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 591/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:57.234625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:57.309279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:57.331267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c525b-7e8c-45eb-907a-6495b3b03ba9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:57.363409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:57.364285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:57.364565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:57.364839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] PATH_INFO: `/v3/users/82f73744fafd4ecc84a66e7ed0c445f9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:57.366585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] RBAC: Authorizing `identity:get_user(user_id=82f73744fafd4ecc84a66e7ed0c445f9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:57.368013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:57.369609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 599/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:47:57 2022] GET /identity/v3/users/82f73744fafd4ecc84a66e7ed0c445f9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:57.375364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:57.469273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb779754-9361-4838-8a94-6df0d217929f None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:57.503784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a0745-762f-42fb-afc1-df1fe8396913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:57.504657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0745-762f-42fb-afc1-df1fe8396913 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:57.504939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0745-762f-42fb-afc1-df1fe8396913 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:57.505212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a0745-762f-42fb-afc1-df1fe8396913 None admin] PATH_INFO: `/v3/projects/322bc726f4f04da4934e9e892c6e6816` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:57.506404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a0745-762f-42fb-afc1-df1fe8396913 None admin] RBAC: Authorizing `identity:get_project(project_id=322bc726f4f04da4934e9e892c6e6816)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:57.507812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a0745-762f-42fb-afc1-df1fe8396913 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:57.509530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 592/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:47:57 2022] GET /identity/v3/projects/322bc726f4f04da4934e9e892c6e6816 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:47:57.517462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:57.613571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1989ef9-bfec-49d2-8fb4-b944abf9acd4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:57.644882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027a1fd-bf94-411c-9486-72b4103cfa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:57.645756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027a1fd-bf94-411c-9486-72b4103cfa3b None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:57.646038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027a1fd-bf94-411c-9486-72b4103cfa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:57.646312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027a1fd-bf94-411c-9486-72b4103cfa3b None admin] PATH_INFO: `/v3/projects/322bc726f4f04da4934e9e892c6e6816/users/82f73744fafd4ecc84a66e7ed0c445f9/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:57.648746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027a1fd-bf94-411c-9486-72b4103cfa3b None admin] RBAC: Authorizing `identity:create_grant(project_id=322bc726f4f04da4934e9e892c6e6816, user_id=82f73744fafd4ecc84a66e7ed0c445f9, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:47:57.650162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027a1fd-bf94-411c-9486-72b4103cfa3b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:47:57.662977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 600/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:47:57 2022] PUT /identity/v3/projects/322bc726f4f04da4934e9e892c6e6816/users/82f73744fafd4ecc84a66e7ed0c445f9/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:47:59.643470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98040086-c9fa-48c9-a839-55aabb3fd827 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:59.644126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98040086-c9fa-48c9-a839-55aabb3fd827 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:59.644126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98040086-c9fa-48c9-a839-55aabb3fd827 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:59.645425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 593/1193] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:47:59.650661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:59.651093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:59.651194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:59.657094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:59.669839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:47:59.671012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:47:59.734654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 601/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:47:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:47:59.758542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98040086-c9fa-48c9-a839-55aabb3fd827 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:47:59.774637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:47:59.857120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98040086-c9fa-48c9-a839-55aabb3fd827 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:47:59.888516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:47:59.889277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:47:59.889559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:47:59.889833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:47:59.900597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:47:59.908011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:47:59.909112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:47:59.910192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 594/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:47:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:47:59.915507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:00.009217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f1a43-e27c-4da3-a65c-398ba4cb2a98 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:00.042253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:00.042900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:00.043179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:00.043453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:00.044322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:48:00.044630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:00.045980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:00.047267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:00.054443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 602/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:48:00.060010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:00.127809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:00.156671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16beb85-a92c-4a0a-92d6-81742bf95bc4 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:00.189435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:00.190277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:00.190557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:00.190829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] PATH_INFO: `/v3/users/82f73744fafd4ecc84a66e7ed0c445f9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:00.192008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] RBAC: Authorizing `identity:get_user(user_id=82f73744fafd4ecc84a66e7ed0c445f9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:00.193435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:00.195035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 595/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Jun 21 09:48:00 2022] GET /identity/v3/users/82f73744fafd4ecc84a66e7ed0c445f9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:48:00.200812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:00.295141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3eeb01-39c0-4918-a11b-f4d2c8ea3b85 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:00.326745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:00.327364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:00.327643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:00.327913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:00.385208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:00.391690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:00.393137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:00.485440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 603/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:48:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:48:00.491585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:00.585910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65555886-5770-4914-b46b-0db3105f05d2 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:00.618253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc0c84-549a-4b09-87f0-41d7f8b8b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:00.619077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0c84-549a-4b09-87f0-41d7f8b8b7cc None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:00.619355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0c84-549a-4b09-87f0-41d7f8b8b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:00.619632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc0c84-549a-4b09-87f0-41d7f8b8b7cc None admin] PATH_INFO: `/v3/projects/322bc726f4f04da4934e9e892c6e6816` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:00.620820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc0c84-549a-4b09-87f0-41d7f8b8b7cc None admin] RBAC: Authorizing `identity:get_project(project_id=322bc726f4f04da4934e9e892c6e6816)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:00.622227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc0c84-549a-4b09-87f0-41d7f8b8b7cc None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:00.623880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 596/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Jun 21 09:48:00 2022] GET /identity/v3/projects/322bc726f4f04da4934e9e892c6e6816 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:48:00.629762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:00.717790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:00.723621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f8623-374b-4b3c-9dee-d2c25de9dbb4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:00.756028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:00.756603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:00.756883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:00.757154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:00.757977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=322bc726f4f04da4934e9e892c6e6816, user.id=82f73744fafd4ecc84a66e7ed0c445f9) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:48:00.758286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:00.759679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd1edc3-0520-4a1e-9d34-d1fb16185dfb None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:00.765247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 604/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:48:00 2022] GET /identity/v3/role_assignments?user.id=82f73744fafd4ecc84a66e7ed0c445f9&scope.project.id=322bc726f4f04da4934e9e892c6e6816&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:48:10.614286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:10.762680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=20 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:55.516876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e1c76-32df-4f6f-8a3d-0f1c1037c6e5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:55.517475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e1c76-32df-4f6f-8a3d-0f1c1037c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:55.517475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e1c76-32df-4f6f-8a3d-0f1c1037c6e5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:55.519012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 597/1201] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:48:55.524450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:55.524917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:55.525012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:55.543697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:48:55.545188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:48:55.634099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 605/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:48:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:48:55.660121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e1c76-32df-4f6f-8a3d-0f1c1037c6e5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:55.806413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e1c76-32df-4f6f-8a3d-0f1c1037c6e5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:55.848399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:55.849934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:55.850244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:55.850518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:55.862882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:55.864997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:48:55.886350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:48:55.887520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:48:55.888823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:48:55.888823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:48:55.888823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:48:55.888823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:48:55.892286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 598/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:48:55.893989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:56.034054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d700-e713-4278-b885-cf4a72c331ed None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:56.072542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:56.079086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:56.079849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:56.080213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:56.080434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:56.081196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:48:56.081613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:56.083606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e5b1b-3db4-4cac-b0b0-b2180a93c7f4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:56.103024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 606/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:48:56.109446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:56.185605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:56.250767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea4afb-f972-4797-beb1-806e5276275c None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:56.291438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cac83-4d57-444d-9323-9863bb45fe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:56.292517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cac83-4d57-444d-9323-9863bb45fe27 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:56.293016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cac83-4d57-444d-9323-9863bb45fe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:56.293296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cac83-4d57-444d-9323-9863bb45fe27 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:56.294037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cac83-4d57-444d-9323-9863bb45fe27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:56.295551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cac83-4d57-444d-9323-9863bb45fe27 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:56.324293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 599/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Jun 21 09:48:56 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:48:58.609393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b0ba7-51be-4bb3-a70f-a149924a730f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:58.610165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b0ba7-51be-4bb3-a70f-a149924a730f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:58.610165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b0ba7-51be-4bb3-a70f-a149924a730f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:58.611327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 607/1206] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:48:58.618234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:58.618728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:58.618832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:58.639012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:48:58.640465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:48:58.719418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 600/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:48:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:48:58.745871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b0ba7-51be-4bb3-a70f-a149924a730f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:58.886503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b0ba7-51be-4bb3-a70f-a149924a730f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:58.922351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:58.923147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:58.923471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:58.923689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:58.935023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:48:58.942778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:48:58.944056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:48:58.945207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:48:58.949115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 608/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:48:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:48:58.950121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:59.007293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:59.078402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b57f0-f707-46eb-9b14-ac8253bce1d2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:59.121825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:59.122521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:59.122804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:59.123293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:59.123992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:48:59.124610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:59.126394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:59.135244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 601/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:48:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:48:59.141790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:59.200128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:59.266497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0051a-3e1c-4492-aae8-4fe5b4534a4a None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:59.306876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:59.307700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:59.308095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:59.308377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:59.320146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:59.321624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:48:59.340046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:48:59.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:48:59.342784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:48:59.342784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:48:59.342784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:48:59.342784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:48:59.342784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 609/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:48:59.347142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:59.456581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:59.460508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26442-a1d4-4e3e-9258-8366c4982449 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:59.499348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:59.500149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:59.500521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:59.500974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:59.502033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:48:59.502546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:59.504262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:59.524183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 602/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:48:59.525686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:59.655454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f97570-d025-41ea-88ce-c2ca982bf1af None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:59.657380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:48:59.697671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:59.698624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:59.699029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:59.699429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:59.708697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:59.710170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:48:59.726065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:48:59.727215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:48:59.728201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 610/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:48:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:48:59.733609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:48:59.848236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460bb5-ebe3-49e2-8c23-85c9a63c6950 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:48:59.895339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:48:59.896154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:48:59.896478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:48:59.896761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:48:59.897571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:48:59.897878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:48:59.899298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:48:59.918703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 603/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 09:48:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:48:59.924002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:00.042425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc62e6-fccd-431c-89db-32d132c062e3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:00.085507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:00.089299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:00.089299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:00.089299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:00.129136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:00.178442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:00.180375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:00.291950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 611/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:48:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:49:00.297745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:00.318147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:00.413339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333faa8-d206-4742-8320-56b5f4b225e0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:00.454280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:00.455157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:00.455542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:00.455824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:00.470272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:00.472114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:00.493808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:00.494874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:00.500478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:00.500478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:00.500478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:00.500478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:00.500478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 604/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:00.500751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:00.570485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:00.618666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b802df7-3c43-450e-a9a6-50b1979ef9f9 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:00.657099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:00.657907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:00.658066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:00.658345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:00.659130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:00.659473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:00.660939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:00.672929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 612/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:00.678676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:00.755705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:00.790941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfff87-9f59-494b-9354-88e2680db369 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:00.828750 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:00.829618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:00.830043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:00.830619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:00.840463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:00.842006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:49:00.863231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:00.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:00.865792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:00.866509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 605/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:00.872063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:00.980975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd8d4b-d2b6-4f05-85a3-22524df7fc02 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:01.010521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:01.027833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:01.028754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:01.029035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:01.029438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:01.030356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:01.030670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:01.032349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336c28d-1033-42c9-ad5a-015b39a9d70e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:01.046090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 613/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:49:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:01.052548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:01.167224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1d925-ea13-468a-b153-0b6cd916c28b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:01.201214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:01.208926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:01.209655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:01.210005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:01.210350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:01.211248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=794d74faad1d449e8a4253b21f01e050) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:01.211629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:01.213185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3315f-acaf-4609-8359-964bc6a75795 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:01.220629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 606/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:49:01 2022] GET /identity/v3/role_assignments?user.id=794d74faad1d449e8a4253b21f01e050&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:49:03.549827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4125a8-b0d0-444b-a7e5-0c1a00030026 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:03.550440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4125a8-b0d0-444b-a7e5-0c1a00030026 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:03.550440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4125a8-b0d0-444b-a7e5-0c1a00030026 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:03.551761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 614/1220] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:03.558042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:03.558781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:03.558781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:03.578340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:03.578340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:03.656074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 607/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:03.682282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4125a8-b0d0-444b-a7e5-0c1a00030026 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:03.788376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4125a8-b0d0-444b-a7e5-0c1a00030026 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:03.825840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:03.826610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:03.826882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:03.827215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:03.838834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:49:03.846942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:03.848115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:03.849613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 615/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:03.855797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:03.959306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e354-85a8-41a0-aeba-fc1feef2e59c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:03.984680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:03.998246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:03.999050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:03.999457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:03.999837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:04.000813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:04.001238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:04.002769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:04.012289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 608/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:49:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:04.018586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:04.066730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:04.125806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90edca2-3dc3-4a8d-a29f-9b8ddf6019a3 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:04.161971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:04.162801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:04.163084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:04.163367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:04.174877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:04.176373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:04.194556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:04.195717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:04.196712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:04.196712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:04.196712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:04.196712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:04.196712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 616/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:04.201543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:04.307879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe9320-de2d-4883-9fbb-9d3147cc1ba9 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:04.344540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:04.345310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:04.345604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:04.345933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:04.346747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:04.347063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:04.348529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:04.362709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 609/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:04.368778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:04.467824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:04.475795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65da595-e4e5-41ed-b7e5-a651c006c349 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:04.510599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:04.511393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:04.511673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:04.511944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:04.519361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:04.521348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:49:04.535758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:04.537489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:04.543611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 617/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:04.544469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:04.591125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:04.651740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830615a9-768f-4ff5-a8e7-da8e999aa266 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:04.688817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:04.689544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:04.689892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:04.690176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:04.691053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:04.691408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:04.693506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:04.712868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 610/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 09:49:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:04.719718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:04.835527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dae82b-2b28-41a2-8e25-2b583f078600 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:04.878079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:04.879283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:04.879611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:04.880450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:04.892258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:04.893936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:04.912911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:04.919471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:04.920556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:04.920556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:04.920556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:04.920556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:04.920556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 618/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:04.920849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:05.029797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daba1a3-13d1-4b56-83ea-4ce18cd69cb0 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:05.032867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:05.068903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:05.069564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:05.069879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:05.070174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:05.070894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:05.071196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:05.072588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:05.084024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 611/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:05.089815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:05.100030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:05.212603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19536955-7671-4020-ac6c-260c382e5267 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:05.256021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:05.257062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:05.257485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:05.257773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:05.266169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:05.268019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:49:05.283512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:05.284653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:05.290640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 619/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:05.291324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:05.407592 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6a174-6650-433e-a25e-bcdeb94905bb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:05.443818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:05.444538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:05.444812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:05.445149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:05.445995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:05.446315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:05.447801 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6dd36-3853-4547-9a54-28c7fee12ea0 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:05.460495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 612/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:49:05.466986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:05.540553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:05.581321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757fec-f66b-45b1-b928-797c2d084ea8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:05.625892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20088843-7b27-4760-aed7-5009149d1054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:05.626788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20088843-7b27-4760-aed7-5009149d1054 None admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:05.627070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20088843-7b27-4760-aed7-5009149d1054 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:05.627344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20088843-7b27-4760-aed7-5009149d1054 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/794d74faad1d449e8a4253b21f01e050/roles/9a1aa581c7e548428b28963a0d3b7aee` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:05.647886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20088843-7b27-4760-aed7-5009149d1054 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=794d74faad1d449e8a4253b21f01e050, role_id=9a1aa581c7e548428b28963a0d3b7aee)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:05.649760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20088843-7b27-4760-aed7-5009149d1054 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:05.664786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 620/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:49:05 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/794d74faad1d449e8a4253b21f01e050/roles/9a1aa581c7e548428b28963a0d3b7aee => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:49:07.742715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184f05-2d44-4382-a5a5-2cc996c6e274 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:07.743267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184f05-2d44-4382-a5a5-2cc996c6e274 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:07.743267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184f05-2d44-4382-a5a5-2cc996c6e274 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:07.744688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 613/1233] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:07.749975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:07.750376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:07.750559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:07.768208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:07.769387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:07.845092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 621/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:07.872623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184f05-2d44-4382-a5a5-2cc996c6e274 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:07.902046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:07.985776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184f05-2d44-4382-a5a5-2cc996c6e274 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:08.022995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:08.023702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:08.024006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:08.024292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:08.035842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:49:08.043902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:08.045218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:08.046370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 614/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Jun 21 09:49:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:08.052314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:08.103927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:08.163988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0c396-0848-4a91-b1db-767c7e5afa71 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:08.202406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:08.203071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:08.203360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:08.203692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:08.204504 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:08.204812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:08.206440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:08.215168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 622/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Jun 21 09:49:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:08.221259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:08.312015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:08.329614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d808f71-09be-4251-aec2-16bee2fb99da None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:08.363499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:08.364867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:08.365149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:08.365421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:08.377907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:08.379391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:08.398103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:08.399208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:08.400287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:08.400287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:08.400287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:08.400287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:08.400287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 615/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:49:08.405103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:08.516189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfb2b-a231-413e-85b2-69e5e5bb7e2b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:08.526205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:08.554787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:08.555456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:08.555738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:08.556036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:08.556758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:08.557064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:08.558447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:08.570859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 623/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:49:08.576425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:08.683823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb7093-ffef-4df4-bc17-d5bb9478195b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:08.720658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:08.721566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:08.721994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:08.722295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:08.726493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:08.732670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:08.734449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:49:08.749867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:08.756145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:08.757317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 616/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:49:08.758045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:08.870406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68b3e7-eed7-48c9-aa7e-9b7d781da01b None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:08.909270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:08.910015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:08.910507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:08.910827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:08.912430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:08.912738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:08.914154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:08.932697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 624/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 09:49:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:49:08.938635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:09.054385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb31f17-217c-4f70-a654-de9c2ba769d6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:09.099323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:09.100297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:09.100587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:09.100861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:09.169890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:09.176694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:09.178141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:09.290748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 617/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:49:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:49:09.297687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:09.327416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:09.427542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3b821-cca8-4e58-83a6-612422323e3f None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:09.467587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:09.468510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:09.468787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:09.469055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:09.480179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:09.481610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:09.503175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:09.504330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:09.509933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:09.509933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:09.509933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:09.509933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:09.509933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 625/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:09.510275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:09.613383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:09.619915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362386a-0a22-4600-9513-bf5f3af251cb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:09.663754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:09.664746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:09.665230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:09.665551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:09.666555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:09.666904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:09.668726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:09.684279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 618/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:09.690812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:09.793153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:09.819577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43d54c-50d0-4c4f-b2d8-1ab73ad46373 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:09.873967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:09.875051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:09.875386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:09.875758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:09.885688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:09.888387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:49:09.909559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:09.910688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:09.911775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 626/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:09.917374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:10.028112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e85b5-c806-4152-8a69-c5719e9573e6 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:10.068744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:10.069452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:10.069738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:10.070018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:10.070871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:10.071182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:10.072872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d7f9-8488-445d-a114-52935e3d119a None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:10.091272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 619/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:10.092771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:10.211999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a637e-7033-460f-a9f7-7be4c97a6c64 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:10.251922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:10.252715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:10.253079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:10.253493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:10.254471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] RBAC: Adding query filter params (role.id=9a1aa581c7e548428b28963a0d3b7aee, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=794d74faad1d449e8a4253b21f01e050) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:10.254880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:10.256607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135b9e0-6e4e-4368-babf-2448956060d4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:10.263506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 627/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:49:10 2022] GET /identity/v3/role_assignments?user.id=794d74faad1d449e8a4253b21f01e050&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=9a1aa581c7e548428b28963a0d3b7aee => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:12.386567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aac85-6014-42a0-90a9-091d3723c257 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:12.387084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aac85-6014-42a0-90a9-091d3723c257 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:12.387084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aac85-6014-42a0-90a9-091d3723c257 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:12.388923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 620/1247] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:12.394935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:12.395447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:12.396155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:12.402169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:12.416740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:12.418152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:12.494386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 628/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 09:49:12.521322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aac85-6014-42a0-90a9-091d3723c257 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:12.539990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:12.634089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aac85-6014-42a0-90a9-091d3723c257 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:12.673763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:12.674483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:12.674768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:12.675060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:12.686515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:49:12.695307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:12.696280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:12.697392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 621/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:49:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:12.703499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:12.815899 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06731849-4723-4da2-b94c-2795d7246ae2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:12.849571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:12.855668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:12.856620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:12.857181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:12.857491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:12.858346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:12.858716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:12.860328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:12.870719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 629/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:49:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:12.879483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:12.966625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:12.993301 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05498f57-c4b6-417c-b6c7-82269334639b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:13.031759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:13.032616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:13.032907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:13.033216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:13.050753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:13.053021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:13.080378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:13.081548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:13.082596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:13.082596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:13.082596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:13.082596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:13.082596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 622/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:13.092442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:13.215558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fb0dd-d352-4f5a-8d38-7e6006e92901 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:13.252330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:13.253086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:13.253327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:13.253624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:13.254322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:13.254628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:13.255986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:13.268406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 630/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:13.274631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:13.392783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46e54-0002-4eaa-ae99-a68a8ae09b7d None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:13.418918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:13.429087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:13.430363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:13.430779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:13.431212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:13.440517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:13.441985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:49:13.459744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:13.460773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:13.466891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 623/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:13.467758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:13.529933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:13.575013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5edbf2-ea96-438b-aefd-ad588ce012af None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:13.607908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:13.608584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:13.608864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:13.609137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:13.609961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:13.610266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:13.611685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:13.629625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 631/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 09:49:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:13.636000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:13.747735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778703c8-951f-465e-8e66-8a56438ee048 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:13.785468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:13.785833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:13.786600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:13.786877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:13.849335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:13.866183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:13.867932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:13.982967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 624/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:49:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:49:13.989915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:14.093350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82979f03-6638-4957-a6fb-e39ac71d501d None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:14.110791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:14.135767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:14.136919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:14.137413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:14.137760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:14.149450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:14.151388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:14.171790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:14.172979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:14.174051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:14.174051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:14.174051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:14.174051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:14.174051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 632/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:49:14.179297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:14.275660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:14.290483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc9bc-f6ff-41b7-94cf-1fbfbbf6b398 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:14.326680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:14.327421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:14.327720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:14.328017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:14.328740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:14.329046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:14.330404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:14.343149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 625/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:49:14.349243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:14.462040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c856-f463-4260-9c05-62c05ae66b12 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:14.499169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:14.500044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:14.500321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:14.500657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:14.509102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:14.510644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:49:14.526581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:14.527739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:14.528693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 633/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 09:49:14.533875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:14.655234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d987fb-54b8-4810-92d3-d246f54a5ee8 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:14.688799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:14.689505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:14.689819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:14.690132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:14.691021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:14.691344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:14.693568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521c53-6003-4352-ab64-b15ea4c2be25 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:14.711433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 626/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:49:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:49:14.718347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:14.745895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:14.835991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18082c75-1bb3-43c5-9cb6-15e3636bc885 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:14.878731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:14.879372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:14.879607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:14.880450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:14.881442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=794d74faad1d449e8a4253b21f01e050) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:14.881788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:14.883473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e1a63-36a0-4971-ae90-979da3a16c92 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:14.889618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 634/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:49:14 2022] GET /identity/v3/role_assignments?user.id=794d74faad1d449e8a4253b21f01e050&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=7adf0608488a4c0780e809cd640a911c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:16.911962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbb09e-540f-47aa-9719-7d561ba6209c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:16.912540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbb09e-540f-47aa-9719-7d561ba6209c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:16.912540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbb09e-540f-47aa-9719-7d561ba6209c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:16.913917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 627/1261] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:16.919078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:16.919483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:16.919642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:16.936278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:16.937454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:17.002171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 635/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:17.024943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbb09e-540f-47aa-9719-7d561ba6209c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:17.035591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:17.124820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbb09e-540f-47aa-9719-7d561ba6209c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:17.156912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:17.157680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:17.157960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:17.158232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:17.167920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:49:17.175488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:17.176450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:17.177868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 628/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:17.183390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:17.201814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:17.279852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecf329-2f91-4f21-aa4e-63785634b380 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:17.312021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:17.312668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:17.312950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:17.313228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:17.313965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:17.314272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:17.315623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:17.323937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 636/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:17.329520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:17.393185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:17.425204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f3da6-c19e-47a3-a1ce-d7782cd48530 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:17.456691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:17.457454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:17.457756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:17.458033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:17.468779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:17.470240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:17.487321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:17.488381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:17.490055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:17.490055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:17.490055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:17.490055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:17.490055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 629/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:17.494786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:17.571644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:17.590084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebae05f-5cef-433a-a443-b87de01a17b4 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:17.622833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:17.623479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:17.623761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:17.624056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:17.624772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:17.625078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:17.626429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:17.637655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 637/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:17.643127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:17.738638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f835dc7-6de5-435f-b240-14c2d8b87e05 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:17.757512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:17.771448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:17.772245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:17.772526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:17.772798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:17.779898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:17.781367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:49:17.795607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:17.796721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:17.797880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 630/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:17.802515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:17.908905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a423216-8425-4260-8c2d-4b9c6d03ee07 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:17.941597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:17.942253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:17.942532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:17.942804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:17.943658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:17.943962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:17.945405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:17.953617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:17.962648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 638/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:17.968262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:18.063501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07303500-371e-4dc2-891c-d116d4f014c5 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:18.095644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:18.096452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:18.096744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:18.097021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:18.108493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:18.109930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:18.127199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:18.128257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:18.129169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:18.129169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:18.129169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:18.129169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:18.129169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 631/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:18.134550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:18.230700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943f9fc-c5be-4f90-a987-a6e12ab2d321 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:18.262979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:18.263626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:18.263907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:18.264214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:18.264925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:18.265231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:18.266581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:18.277976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 639/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:18.283474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:18.313413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:18.379338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5282ca-42a8-4c65-88a6-1cad36a55590 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:18.411939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:18.412736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:18.413016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:18.413292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:18.419761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:18.421232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:49:18.435075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:18.436125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:18.437321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 632/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:49:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:18.446244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:18.503248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:18.543539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0733b-748a-4706-8bf4-e2396a72993e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:18.576284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:18.576926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:18.577210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:18.577486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:18.578267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:18.578579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:18.580025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec889b1-a583-447d-b3b5-77d767eb1d6b None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:18.592420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 640/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:49:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:18.598402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:18.686105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:18.695464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbdfdd-57ee-4878-96a7-67444d584f12 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:18.727825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d91b2b-7937-4d76-8fe9-b4c5ffc9e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:18.728724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91b2b-7937-4d76-8fe9-b4c5ffc9e030 None admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:18.729008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91b2b-7937-4d76-8fe9-b4c5ffc9e030 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:18.729284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d91b2b-7937-4d76-8fe9-b4c5ffc9e030 None admin] PATH_INFO: `/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/794d74faad1d449e8a4253b21f01e050/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:18.731273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91b2b-7937-4d76-8fe9-b4c5ffc9e030 None admin] RBAC: Authorizing `identity:create_grant(project_id=660aaf4d825d4d29af5f2522f64a3daa, user_id=794d74faad1d449e8a4253b21f01e050, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:18.732738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d91b2b-7937-4d76-8fe9-b4c5ffc9e030 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:18.745421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 633/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Jun 21 09:49:18 2022] PUT /identity/v3/projects/660aaf4d825d4d29af5f2522f64a3daa/users/794d74faad1d449e8a4253b21f01e050/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:49:20.750198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68bfd7-4b70-4a42-9f4f-c30fd51ad0b1 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:20.750742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68bfd7-4b70-4a42-9f4f-c30fd51ad0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:20.750742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68bfd7-4b70-4a42-9f4f-c30fd51ad0b1 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:20.752164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 641/1274] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:20.757964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:20.758365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:20.758525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:20.775488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:20.776695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:20.843218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 634/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:20.867615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68bfd7-4b70-4a42-9f4f-c30fd51ad0b1 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:20.975584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68bfd7-4b70-4a42-9f4f-c30fd51ad0b1 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:20.992375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:21.009405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.010116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.010398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.010671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:21.020290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 09:49:21.027998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:21.029080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:21.030138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 642/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Jun 21 09:49:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:21.035183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:21.116977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:21.135919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f7d9d-3d90-4dde-8298-28037a6bd8af None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:21.168483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.169138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.169423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.169698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:21.170434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:21.170739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:21.172107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:21.180526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 635/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Jun 21 09:49:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:21.186131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:21.282123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e96ed-2073-454c-b46d-e3c98d79f8f8 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:21.314356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.315121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.315401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.315675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:21.325830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:21.327247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:21.343619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:21.344717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:21.345827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:21.345827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:21.345827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:21.345827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:21.345827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 643/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:21.351413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:21.446305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45075-acfa-4fd5-a526-bca806491200 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:21.478098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.478730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.479009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.479282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:21.480006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:21.480314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:21.481649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:21.493342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 636/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:21.498734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:21.529046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:21.596606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8371d8f-7010-4eb9-9d7e-c64a6d54c453 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:21.628819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.629596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.629881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.630157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:21.637343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:21.638764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 09:49:21.653145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:21.654077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:21.655060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 644/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:21.659993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:21.664294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:21.756345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62134b12-bf10-4314-8d71-9cc458392f92 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:21.789268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.789919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.790201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.790478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:21.791303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:21.791613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:21.793065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:21.809223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 637/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Jun 21 09:49:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:21.814831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:21.904695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:21.914115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f972cc-4c65-4acd-9f7a-5cdd77967640 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:21.946290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:21.946928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:21.947209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:21.947487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:22.012225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:22.013650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:22.097874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:22.108729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 645/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Jun 21 09:49:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 09:49:22.114427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:22.173600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:22.211658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e6906-34e3-4bcf-94ce-82fa028cab65 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:22.245030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:22.245802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:22.246086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:22.246367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:22.256116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:22.257548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 09:49:22.275717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:22.276790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:22.278030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 09:49:22.278030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 09:49:22.278030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 09:49:22.278030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:22.278030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 638/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:22.282509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:22.377041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d6c1-89c0-4af3-8d07-05791847181e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:22.415381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:22.416283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:22.416705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:22.417112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:22.418176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:22.418597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:22.420611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:22.432099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 646/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Jun 21 09:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:22.437534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:22.532026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823e7e-c590-4132-ad53-4d7b66893e0b None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:22.545194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:22.564889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:22.565652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:22.565934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:22.566206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:22.573240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:22.574680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 09:49:22.588062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:22.589083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: ERROR keystone.server.flask.application Jun 21 09:49:22.590242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 639/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Jun 21 09:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:22.594780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:22.643291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:22.691710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202d751-2378-477a-8dd2-43bf2f081ec2 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:22.724982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:22.725885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:22.726171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:22.726451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:22.727231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:22.727544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:22.728993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe467043-8016-468a-a747-0fcda1e54082 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:22.741264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 647/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Jun 21 09:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:22.747283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:22.844765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1c17-893d-44a7-a497-2bf8362bfdfb None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:22.877761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:22.878405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:22.878690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:22.878968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:22.879855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] RBAC: Adding query filter params (role.id=7adf0608488a4c0780e809cd640a911c, scope.project.id=660aaf4d825d4d29af5f2522f64a3daa, user.id=794d74faad1d449e8a4253b21f01e050) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:22.880205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:22.882154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f418f-7859-43d3-a276-52d0f627d9ed None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:22.887858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 640/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Jun 21 09:49:22 2022] GET /identity/v3/role_assignments?user.id=794d74faad1d449e8a4253b21f01e050&scope.project.id=660aaf4d825d4d29af5f2522f64a3daa&role.id=7adf0608488a4c0780e809cd640a911c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:24.896987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7788dd-978f-4cf6-b361-6c6f58bd4476 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:24.897513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7788dd-978f-4cf6-b361-6c6f58bd4476 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:24.897513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7788dd-978f-4cf6-b361-6c6f58bd4476 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:24.898912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 648/1288] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:24.904186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:24.904579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:24.904748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:24.921635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:24.922817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:24.951583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:24.987693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 641/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:25.010367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7788dd-978f-4cf6-b361-6c6f58bd4476 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:25.108460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7788dd-978f-4cf6-b361-6c6f58bd4476 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:25.119416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:25.142117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:25.142892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:25.143172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:25.143450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:25.144120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:25.145473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:25.157029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:25.158231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:25.159389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 649/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:49:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:25.164545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:25.264752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a9b463-064d-43be-be90-8268d9c9c56b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:25.297323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:25.297971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:25.298250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:25.298522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:25.299219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:25.299522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:25.300904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f29c1e-9c25-4738-9646-245241d67527 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:25.305571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 642/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 09:49:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:25.311264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:25.405523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553761df-95e1-48e9-91fd-8ed64a926327 None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:25.437240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:25.437819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:25.438097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:25.438368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] PATH_INFO: `/v3/services` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:25.439063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:25.439366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:25.440734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345607a5-89a0-42d2-804c-8c943ab95f86 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:25.445147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 650/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 09:49:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:27.449090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee63c-d37f-4a68-86ec-1e995367a861 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:27.449634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee63c-d37f-4a68-86ec-1e995367a861 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:27.449634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ee63c-d37f-4a68-86ec-1e995367a861 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:27.450920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 643/1293] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:27.455869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a423-5de3-4dcd-b849-3582de1b0297 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:27.456351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a423-5de3-4dcd-b849-3582de1b0297 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:27.456449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825a423-5de3-4dcd-b849-3582de1b0297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:27.473429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c825a423-5de3-4dcd-b849-3582de1b0297 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:27.474601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c825a423-5de3-4dcd-b849-3582de1b0297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:27.503260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:27.540183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 651/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:27.563237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee63c-d37f-4a68-86ec-1e995367a861 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:27.593482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:27.661914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ee63c-d37f-4a68-86ec-1e995367a861 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:27.694754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761dfae-1de1-42c8-a265-b1a5ebd44656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:27.695392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761dfae-1de1-42c8-a265-b1a5ebd44656 None admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:27.695709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761dfae-1de1-42c8-a265-b1a5ebd44656 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:27.696009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761dfae-1de1-42c8-a265-b1a5ebd44656 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:27.696722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761dfae-1de1-42c8-a265-b1a5ebd44656 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:27.698076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761dfae-1de1-42c8-a265-b1a5ebd44656 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:27.710299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 644/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Jun 21 09:49:27 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:49:29.717487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7913b-b7f6-4972-a36c-aad686406925 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:29.718047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7913b-b7f6-4972-a36c-aad686406925 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:29.718047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7913b-b7f6-4972-a36c-aad686406925 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:29.719401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 652/1296] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:29.724422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:29.725597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:29.725852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:29.742161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:29.743329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:29.813211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 645/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:29.836444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7913b-b7f6-4972-a36c-aad686406925 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:29.946488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7913b-b7f6-4972-a36c-aad686406925 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:29.979852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:29.980662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:29.980948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:29.981229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:29.981876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:29.983235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:29.994981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:29.996179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:29.997095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 653/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:49:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:30.002436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:30.020038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:30.098082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e7592-039b-47f7-a21d-4dd7098c2bba None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:30.134483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:30.135138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:30.135417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:30.135689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:30.136542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:30.136849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:30.138208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:30.143232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 646/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 09:49:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:30.149841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:30.180245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:30.246783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fe5d8-e5e9-44cd-a18a-2c90faa09d0e None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:30.279473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:30.280140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:30.280426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:30.280705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:30.281489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] RBAC: Adding query filter params (interface=public, service_id=856af05ca1514b0fbf46e819823a4248, region_id=RegionOne) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:30.281802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:30.283158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be531ac0-0795-4abc-9378-52a217e298cd None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:30.288088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 654/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Jun 21 09:49:30 2022] GET /identity/v3/endpoints?service_id=856af05ca1514b0fbf46e819823a4248&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:30.293631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:30.371511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:30.389672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f7452-2d76-4bb8-8a05-bc517e515d50 None admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:30.422227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837ba9cc-6f3a-4c9e-b372-d90146b2dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:30.422897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba9cc-6f3a-4c9e-b372-d90146b2dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:30.423179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba9cc-6f3a-4c9e-b372-d90146b2dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:30.423453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ba9cc-6f3a-4c9e-b372-d90146b2dba2 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:30.424170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba9cc-6f3a-4c9e-b372-d90146b2dba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:30.425572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837ba9cc-6f3a-4c9e-b372-d90146b2dba2 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:30.432580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 647/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Jun 21 09:49:30 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:49:32.422616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bff79-49b9-46c6-9f18-f51c76314040 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:32.423132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bff79-49b9-46c6-9f18-f51c76314040 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:32.423132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bff79-49b9-46c6-9f18-f51c76314040 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:32.424490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 655/1302] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:49:32.429547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:32.429920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:32.430097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:32.446682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:49:32.447836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:49:32.511779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 648/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:49:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 09:49:32.535202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bff79-49b9-46c6-9f18-f51c76314040 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:32.625866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:32.633174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bff79-49b9-46c6-9f18-f51c76314040 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:32.665491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:32.666262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:32.666541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:32.666813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:32.667452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:32.668826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 09:49:32.680625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 09:49:32.681821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application with Lock( Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self._enter() Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application return self.creator() Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application created_value = creator( Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: ERROR keystone.server.flask.application Jun 21 09:49:32.682727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 656/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Jun 21 09:49:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 09:49:32.687588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:32.761500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:32.783347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709d130-e0a1-42fb-a7c2-287cf7516792 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:32.815852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:32.816525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:32.816810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:32.817087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] PATH_INFO: `/v3/services` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:32.817785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:49:32.818092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:32.820092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e6713-9fde-4886-b786-58bc4413fc86 None admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:32.825097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 649/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Jun 21 09:49:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:49:32.830632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:49:32.925672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f5872-be1b-445a-943a-50aadbe70ccb None admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:49:32.957984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda729a1-ff00-4ded-bd50-b7758c6d4a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:49:32.958563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda729a1-ff00-4ded-bd50-b7758c6d4a12 None admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:49:32.958868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda729a1-ff00-4ded-bd50-b7758c6d4a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:49:32.959145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda729a1-ff00-4ded-bd50-b7758c6d4a12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:49:32.959869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda729a1-ff00-4ded-bd50-b7758c6d4a12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:49:32.961248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda729a1-ff00-4ded-bd50-b7758c6d4a12 None admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:49:32.978482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 657/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Jun 21 09:49:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:49:42.822109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=30 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:49:42.974462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:35.321034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6dc5c-02aa-491a-981d-a25478c82d70 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:35.321611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6dc5c-02aa-491a-981d-a25478c82d70 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:35.321611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6dc5c-02aa-491a-981d-a25478c82d70 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:35.328244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f9e6-10dd-4b28-963a-b661a5e4704e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:35.328732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f9e6-10dd-4b28-963a-b661a5e4704e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:35.328823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535f9e6-10dd-4b28-963a-b661a5e4704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:35.332445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 650/1307] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:35 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:35.408626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-8535f9e6-10dd-4b28-963a-b661a5e4704e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:35.409762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8535f9e6-10dd-4b28-963a-b661a5e4704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:35.524357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 658/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:50:35.591762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28bd9-37ee-4fec-8c60-7cec11e63490 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:35.592130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28bd9-37ee-4fec-8c60-7cec11e63490 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:35.592421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28bd9-37ee-4fec-8c60-7cec11e63490 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:35.594167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 651/1309] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jun 21 09:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:35.606537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448cf8-03f5-4a38-a9dd-e0bab68ab7f5 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:35.607274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448cf8-03f5-4a38-a9dd-e0bab68ab7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:35.607734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89448cf8-03f5-4a38-a9dd-e0bab68ab7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:35.730007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-89448cf8-03f5-4a38-a9dd-e0bab68ab7f5 None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:35.732604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-89448cf8-03f5-4a38-a9dd-e0bab68ab7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:35.770805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:35.850344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 659/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jun 21 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:35.860407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28bd9-37ee-4fec-8c60-7cec11e63490 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:35.862150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-83e28bd9-37ee-4fec-8c60-7cec11e63490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:35.982004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28bd9-37ee-4fec-8c60-7cec11e63490 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:36.058070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:36.058725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:36.059009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:36.059288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:36.060951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:36.119349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:36.176730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:36.178215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d06972-34ac-425f-9b38-bd70388efe1c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:36.197855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 652/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:38.513007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196fb28-49de-46e7-b11d-9f189bb3b437 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:38.513563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196fb28-49de-46e7-b11d-9f189bb3b437 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:38.513563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196fb28-49de-46e7-b11d-9f189bb3b437 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:38.514926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 660/1312] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:38.520064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952988-188c-4ddf-89bb-2e3d8c294f29 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:38.520446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952988-188c-4ddf-89bb-2e3d8c294f29 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:38.520618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16952988-188c-4ddf-89bb-2e3d8c294f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:38.607196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-16952988-188c-4ddf-89bb-2e3d8c294f29 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:38.609171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-16952988-188c-4ddf-89bb-2e3d8c294f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:38.709748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 653/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:38.748034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196fb28-49de-46e7-b11d-9f189bb3b437 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:38.749704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a196fb28-49de-46e7-b11d-9f189bb3b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:38.875943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196fb28-49de-46e7-b11d-9f189bb3b437 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:38.956637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:38.959443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:38.960237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:38.960643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:38.961290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:38.963577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:39.077914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:39.079547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c02f07-105d-4a6d-ac12-7f9ac0fa6f9f service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:39.105317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 661/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:41.448778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b7c1d-ba62-4eee-8eb8-a90f51543df9 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:41.449292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b7c1d-ba62-4eee-8eb8-a90f51543df9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:41.449292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b7c1d-ba62-4eee-8eb8-a90f51543df9 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:41.450643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 654/1315] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:41.455771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9a94-2a4d-49f2-98f6-55e2252dfb07 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:41.456169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9a94-2a4d-49f2-98f6-55e2252dfb07 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:41.456358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b9a94-2a4d-49f2-98f6-55e2252dfb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:41.519369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3f8b9a94-2a4d-49f2-98f6-55e2252dfb07 None None] MFA Rules not processed for user `c88fdfdb752649fdb268dae651ed0b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:41.520582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3f8b9a94-2a4d-49f2-98f6-55e2252dfb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:41.570825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:41.614491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 662/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:41.653824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b7c1d-ba62-4eee-8eb8-a90f51543df9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:41.655393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a17b7c1d-ba62-4eee-8eb8-a90f51543df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:41.665529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:41.761075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b7c1d-ba62-4eee-8eb8-a90f51543df9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:41.832744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:41.833385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:41.833668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:41.834449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:41.836116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:41.896890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:41.942833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:41.944292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a189a-86e7-4bcc-8498-a7bcf5c7e8a3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:41.962127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 655/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:44.550811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081390-6036-4cbe-a5ac-98fa83750c59 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:44.551339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081390-6036-4cbe-a5ac-98fa83750c59 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:44.551339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62081390-6036-4cbe-a5ac-98fa83750c59 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:44.553374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 663/1318] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:44.558498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8a93-15fd-4028-9717-371cad5f9289 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:44.558897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8a93-15fd-4028-9717-371cad5f9289 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:44.559058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f8a93-15fd-4028-9717-371cad5f9289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:44.622436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5a6f8a93-15fd-4028-9717-371cad5f9289 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:44.623633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5a6f8a93-15fd-4028-9717-371cad5f9289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:44.715940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 656/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:44.769924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf77be-19b1-45b9-aa3c-a492f4f26a57 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:44.770210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf77be-19b1-45b9-aa3c-a492f4f26a57 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:44.770489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf77be-19b1-45b9-aa3c-a492f4f26a57 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:44.771931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 664/1320] 10.222.0.36 () {54 vars in 964 bytes} [Tue Jun 21 09:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:44.777804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9d3b-db26-4d3a-8e5d-d6eabe653c10 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:44.778094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9d3b-db26-4d3a-8e5d-d6eabe653c10 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:44.778368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9d3b-db26-4d3a-8e5d-d6eabe653c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:44.798888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:44.857170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a1db9d3b-db26-4d3a-8e5d-d6eabe653c10 None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:44.858648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a1db9d3b-db26-4d3a-8e5d-d6eabe653c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:44.942876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 657/1321] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Jun 21 09:50:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:44.952034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf77be-19b1-45b9-aa3c-a492f4f26a57 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:44.953557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-88bf77be-19b1-45b9-aa3c-a492f4f26a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:45.054180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf77be-19b1-45b9-aa3c-a492f4f26a57 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:45.126418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:45.127006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:45.127288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:45.127565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:45.129293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:45.136557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:45.236020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:45.237458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be5b6c-144f-4cc8-82a7-63a83d36af1d service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:45.254938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 665/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:50:48.371336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e911f6e-5d35-4b3f-bf75-c263ff80afe3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:48.371862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e911f6e-5d35-4b3f-bf75-c263ff80afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:48.371862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e911f6e-5d35-4b3f-bf75-c263ff80afe3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:48.373249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 658/1323] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:48.378545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ac7c-93df-4a06-b77d-008b67952914 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:48.378954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ac7c-93df-4a06-b77d-008b67952914 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:48.379100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ac7c-93df-4a06-b77d-008b67952914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:48.444298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0296ac7c-93df-4a06-b77d-008b67952914 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:48.445479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0296ac7c-93df-4a06-b77d-008b67952914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:48.502075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:48.547839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 666/1324] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:48.584981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e911f6e-5d35-4b3f-bf75-c263ff80afe3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:48.586532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9e911f6e-5d35-4b3f-bf75-c263ff80afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:48.695493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e911f6e-5d35-4b3f-bf75-c263ff80afe3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:48.707693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:48.768279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:48.768921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:48.769201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:48.769473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:48.771128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:48.878572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:48.880017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a5835-2eb3-4ab6-9c78-27a1853825f4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:48.898632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 659/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:50.998942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f0dd-da31-4951-b1e5-39be8df89055 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:50.999509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f0dd-da31-4951-b1e5-39be8df89055 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:50.999509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31f0dd-da31-4951-b1e5-39be8df89055 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:51.000882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 667/1326] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:51.006037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530d6b-d892-472e-955e-b204ef2304a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:51.006468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530d6b-d892-472e-955e-b204ef2304a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:51.006611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1530d6b-d892-472e-955e-b204ef2304a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:51.054078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:51.071682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e1530d6b-d892-472e-955e-b204ef2304a1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:51.072899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1530d6b-d892-472e-955e-b204ef2304a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:51.178917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 660/1327] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:51.215355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f0dd-da31-4951-b1e5-39be8df89055 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:51.216924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bb31f0dd-da31-4951-b1e5-39be8df89055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:51.319469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31f0dd-da31-4951-b1e5-39be8df89055 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:51.394759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:51.395395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:51.395673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:51.395943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:51.398219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:51.414657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:51.504242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:51.506193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4d0f5-5c2a-417c-830f-c44cdb433bd6 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:51.524383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 668/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:53.633360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b7574-5c47-414c-8882-f2da201bb589 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:53.633875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b7574-5c47-414c-8882-f2da201bb589 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:53.633997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b7574-5c47-414c-8882-f2da201bb589 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:53.635303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 661/1329] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:53.640909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65158-987d-47f8-89ec-23d6cfc2ad2f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:53.641411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65158-987d-47f8-89ec-23d6cfc2ad2f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:53.641640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b65158-987d-47f8-89ec-23d6cfc2ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:53.708228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d7b65158-987d-47f8-89ec-23d6cfc2ad2f None None] MFA Rules not processed for user `c88fdfdb752649fdb268dae651ed0b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:53.709992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d7b65158-987d-47f8-89ec-23d6cfc2ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:53.779106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:53.811052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 669/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:53.848985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b7574-5c47-414c-8882-f2da201bb589 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:53.850520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c73b7574-5c47-414c-8882-f2da201bb589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:53.954823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b7574-5c47-414c-8882-f2da201bb589 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:53.975048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:54.028471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:54.029122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:54.029406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:54.029685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:54.031325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:54.159226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:54.160761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e16148-1552-44a5-8b34-a7d15e702d11 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:54.180619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 662/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:56.447382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3341-0322-4a22-97a2-bbb54cdc299f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:56.447935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3341-0322-4a22-97a2-bbb54cdc299f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:56.447935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d3341-0322-4a22-97a2-bbb54cdc299f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:56.449318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 670/1332] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:56.454325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93e6e-1c4d-48e3-a3d8-d44e078c6ad0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:56.454743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93e6e-1c4d-48e3-a3d8-d44e078c6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:56.454888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93e6e-1c4d-48e3-a3d8-d44e078c6ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:56.515865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:56.518518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0ce93e6e-1c4d-48e3-a3d8-d44e078c6ad0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:56.520239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0ce93e6e-1c4d-48e3-a3d8-d44e078c6ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:56.614680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 663/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:56.649577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d3341-0322-4a22-97a2-bbb54cdc299f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:56.651087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-729d3341-0322-4a22-97a2-bbb54cdc299f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:56.751007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d3341-0322-4a22-97a2-bbb54cdc299f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:56.821323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:56.821955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:56.822236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:56.822510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:56.824258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:56.852411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:56.931894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:56.933271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9e782-3ace-451f-ac1f-f6408af2bbf2 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:56.951184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 671/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:50:59.018500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291308e-9363-4597-9593-4fffc1f4264f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:59.019149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291308e-9363-4597-9593-4fffc1f4264f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:59.019149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291308e-9363-4597-9593-4fffc1f4264f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:59.020491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 664/1335] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:50:59.026121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde9ae-810a-4184-9089-cd43a8568bdc None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:59.026567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde9ae-810a-4184-9089-cd43a8568bdc None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:59.026682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde9ae-810a-4184-9089-cd43a8568bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:59.092762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3ffde9ae-810a-4184-9089-cd43a8568bdc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:50:59.093953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3ffde9ae-810a-4184-9089-cd43a8568bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:59.167167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:59.189015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 672/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:50:59.229176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291308e-9363-4597-9593-4fffc1f4264f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:50:59.230709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8291308e-9363-4597-9593-4fffc1f4264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:59.331312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8291308e-9363-4597-9593-4fffc1f4264f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:50:59.363426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:50:59.411377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:50:59.412699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:50:59.412980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:50:59.413252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:50:59.414886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:50:59.520299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:50:59.522246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f8328-5f61-4b50-91fb-f23e1c82703b service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:50:59.539331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 665/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:01.893088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2efb-3577-4354-be94-979c7733f015 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:01.893655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2efb-3577-4354-be94-979c7733f015 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:01.893655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb2efb-3577-4354-be94-979c7733f015 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:01.895018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 673/1338] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:01.900350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327fb6-14dd-46cf-bf84-0038b9c6a966 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:01.900747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327fb6-14dd-46cf-bf84-0038b9c6a966 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:01.900909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327fb6-14dd-46cf-bf84-0038b9c6a966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:01.963267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-29327fb6-14dd-46cf-bf84-0038b9c6a966 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:01.964492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-29327fb6-14dd-46cf-bf84-0038b9c6a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:01.972457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:02.061655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 666/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:02.097384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2efb-3577-4354-be94-979c7733f015 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:02.098951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ffbb2efb-3577-4354-be94-979c7733f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:02.200677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb2efb-3577-4354-be94-979c7733f015 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:02.272350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:02.272987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:02.273269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:02.273545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:02.275175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:02.310357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:02.386512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:02.388073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207cda4-e81e-473f-a55d-a58dae3d0e05 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:02.406716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 674/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:06.348076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6174-0add-4f3e-8017-1356c792e988 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:06.348586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6174-0add-4f3e-8017-1356c792e988 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:06.348586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6174-0add-4f3e-8017-1356c792e988 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:06.350475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 667/1341] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:06.356018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1c601-027a-45bf-bfe5-6309f689ec22 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:06.356468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1c601-027a-45bf-bfe5-6309f689ec22 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:06.356570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1c601-027a-45bf-bfe5-6309f689ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:06.428109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f8a1c601-027a-45bf-bfe5-6309f689ec22 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:06.429350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f8a1c601-027a-45bf-bfe5-6309f689ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:06.520635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:06.533452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 675/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:06.572464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6174-0add-4f3e-8017-1356c792e988 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:06.574581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2f1e6174-0add-4f3e-8017-1356c792e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:06.669369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6174-0add-4f3e-8017-1356c792e988 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:06.672879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70062c4-bdd7-43c4-a800-d1d24007e3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:06.673525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70062c4-bdd7-43c4-a800-d1d24007e3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:06.673809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70062c4-bdd7-43c4-a800-d1d24007e3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:06.674092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70062c4-bdd7-43c4-a800-d1d24007e3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:06.683044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70062c4-bdd7-43c4-a800-d1d24007e3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:06.684518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70062c4-bdd7-43c4-a800-d1d24007e3b5 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:06.693988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 668/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:09.278022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1fe5e-cca1-49a8-a4b6-e5e9dd417002 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:09.278563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1fe5e-cca1-49a8-a4b6-e5e9dd417002 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:09.278563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1fe5e-cca1-49a8-a4b6-e5e9dd417002 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:09.279942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 676/1344] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:09.285062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a212-9f27-4ace-8314-7160b65b6305 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:09.285442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a212-9f27-4ace-8314-7160b65b6305 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:09.285629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a212-9f27-4ace-8314-7160b65b6305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:09.313655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e664a212-9f27-4ace-8314-7160b65b6305 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:09.314839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e664a212-9f27-4ace-8314-7160b65b6305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:09.342239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:09.391627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 669/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:09.429745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1fe5e-cca1-49a8-a4b6-e5e9dd417002 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:09.441108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1fe5e-cca1-49a8-a4b6-e5e9dd417002 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:09.444874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b8114-a83e-4329-b1ad-0519ff82cd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:09.445536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8114-a83e-4329-b1ad-0519ff82cd92 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:09.445819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8114-a83e-4329-b1ad-0519ff82cd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:09.446096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b8114-a83e-4329-b1ad-0519ff82cd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:09.456136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b8114-a83e-4329-b1ad-0519ff82cd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:09.457609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b8114-a83e-4329-b1ad-0519ff82cd92 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:09.468475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 677/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:13.521491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc408b-6f44-4c20-a240-d6acd85c712e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:13.522028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc408b-6f44-4c20-a240-d6acd85c712e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:13.522118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc408b-6f44-4c20-a240-d6acd85c712e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:13.523439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 670/1347] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:13.528839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c41148-31eb-4c0b-b041-9c2e2012ec61 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:13.529297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c41148-31eb-4c0b-b041-9c2e2012ec61 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:13.529389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c41148-31eb-4c0b-b041-9c2e2012ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:13.546442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-80c41148-31eb-4c0b-b041-9c2e2012ec61 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:13.547620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-80c41148-31eb-4c0b-b041-9c2e2012ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:13.555885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 678/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:13.594936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc408b-6f44-4c20-a240-d6acd85c712e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:13.606662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc408b-6f44-4c20-a240-d6acd85c712e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:13.610719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faf5fa-62a5-4a35-95ba-814503cc1749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:13.610941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf5fa-62a5-4a35-95ba-814503cc1749 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:13.611200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf5fa-62a5-4a35-95ba-814503cc1749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:13.611481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf5fa-62a5-4a35-95ba-814503cc1749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:13.622329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faf5fa-62a5-4a35-95ba-814503cc1749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:13.623788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faf5fa-62a5-4a35-95ba-814503cc1749 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:13.634064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 671/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:18.649640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393080-e211-4807-982b-47df7d23856e None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:18.650484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393080-e211-4807-982b-47df7d23856e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:18.651218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393080-e211-4807-982b-47df7d23856e None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:18.654347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 679/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:51:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:18.661155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d078c8-1db6-45ff-ae9b-ceb12f8c141f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:18.664441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d078c8-1db6-45ff-ae9b-ceb12f8c141f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:18.664962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d078c8-1db6-45ff-ae9b-ceb12f8c141f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:18.800934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-66d078c8-1db6-45ff-ae9b-ceb12f8c141f None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:18.803013 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-66d078c8-1db6-45ff-ae9b-ceb12f8c141f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:18.881278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 672/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:51:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:23.013874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07abb-4cd5-46db-9f15-95bfe4d5d3cd None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:23.014461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07abb-4cd5-46db-9f15-95bfe4d5d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:23.014663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d07abb-4cd5-46db-9f15-95bfe4d5d3cd None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:23.016383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 680/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:23.021979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af500c-6da4-4b18-9903-bedf625c919b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:23.022424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af500c-6da4-4b18-9903-bedf625c919b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:23.022531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af500c-6da4-4b18-9903-bedf625c919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:23.041436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-00af500c-6da4-4b18-9903-bedf625c919b None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:23.042628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-00af500c-6da4-4b18-9903-bedf625c919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:23.051193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 673/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:51:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:23.542016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=13 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:24.453820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65c122-30ec-4693-b7da-efd437313cec None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:24.454443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65c122-30ec-4693-b7da-efd437313cec None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:24.454443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65c122-30ec-4693-b7da-efd437313cec None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:24.455739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 681/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:24.460850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b991-7ee3-4af1-8754-7e427f0009ed None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:24.461279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b991-7ee3-4af1-8754-7e427f0009ed None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:24.461401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4b991-7ee3-4af1-8754-7e427f0009ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:24.480060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-87f4b991-7ee3-4af1-8754-7e427f0009ed None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:24.481554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-87f4b991-7ee3-4af1-8754-7e427f0009ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:24.490848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 674/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:51:28.229237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022df94-eee8-4411-8819-083a1c82abe6 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:28.230235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022df94-eee8-4411-8819-083a1c82abe6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:28.230514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022df94-eee8-4411-8819-083a1c82abe6 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:28.232091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 682/1356] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:28.237925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eea2e-11d1-4c6b-8cbe-c0ba4e756e43 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:28.239026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eea2e-11d1-4c6b-8cbe-c0ba4e756e43 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:28.240095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833eea2e-11d1-4c6b-8cbe-c0ba4e756e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:28.261503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-833eea2e-11d1-4c6b-8cbe-c0ba4e756e43 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:28.262809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-833eea2e-11d1-4c6b-8cbe-c0ba4e756e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:28.271218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 675/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:28.325178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582721-bf07-43e0-a402-ef31d171e50a None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:28.325944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582721-bf07-43e0-a402-ef31d171e50a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:28.326544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582721-bf07-43e0-a402-ef31d171e50a None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:28.328614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 683/1358] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 09:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:51:28.338467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e00b5b-e418-45c0-a626-551eeac488f4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:28.339038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e00b5b-e418-45c0-a626-551eeac488f4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:28.339535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e00b5b-e418-45c0-a626-551eeac488f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:28.387526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:28.396529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-32e00b5b-e418-45c0-a626-551eeac488f4 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:28.397742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-32e00b5b-e418-45c0-a626-551eeac488f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:28.482442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 676/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 09:51:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:28.490680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582721-bf07-43e0-a402-ef31d171e50a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:28.508665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582721-bf07-43e0-a402-ef31d171e50a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:28.514135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7abd9-eb67-4e43-8174-b1401a70fe97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:28.514772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7abd9-eb67-4e43-8174-b1401a70fe97 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:28.515055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7abd9-eb67-4e43-8174-b1401a70fe97 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:28.515331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7abd9-eb67-4e43-8174-b1401a70fe97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:28.523842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7abd9-eb67-4e43-8174-b1401a70fe97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:28.525459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7abd9-eb67-4e43-8174-b1401a70fe97 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:28.535726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 684/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:30.765596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f4d2-5b0b-4718-94da-bd5ca759c3b5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:30.766145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f4d2-5b0b-4718-94da-bd5ca759c3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:30.766145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814f4d2-5b0b-4718-94da-bd5ca759c3b5 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:30.767694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 677/1361] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:30.772817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2e1c2-d24d-4e2c-bb81-d78234835d21 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:30.773259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2e1c2-d24d-4e2c-bb81-d78234835d21 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:30.773373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2e1c2-d24d-4e2c-bb81-d78234835d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:30.791207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-64d2e1c2-d24d-4e2c-bb81-d78234835d21 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:30.792448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-64d2e1c2-d24d-4e2c-bb81-d78234835d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:30.800364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 685/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:51:30.844060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f4d2-5b0b-4718-94da-bd5ca759c3b5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:30.859381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814f4d2-5b0b-4718-94da-bd5ca759c3b5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:30.865425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34143640-0531-46a6-abc7-1c0e9e6f5a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:30.866064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143640-0531-46a6-abc7-1c0e9e6f5a32 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:30.866344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143640-0531-46a6-abc7-1c0e9e6f5a32 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:30.866620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34143640-0531-46a6-abc7-1c0e9e6f5a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:30.875183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34143640-0531-46a6-abc7-1c0e9e6f5a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:30.876816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34143640-0531-46a6-abc7-1c0e9e6f5a32 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:30.887172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 678/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:33.238587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abc65-4b48-434c-ae62-99d41688efd2 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:33.239394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abc65-4b48-434c-ae62-99d41688efd2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:33.239990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abc65-4b48-434c-ae62-99d41688efd2 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:33.241785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 686/1364] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:33.248398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786380e-89bf-4e56-a1e7-611786d4786a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:33.248804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786380e-89bf-4e56-a1e7-611786d4786a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:33.248960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786380e-89bf-4e56-a1e7-611786d4786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:33.269521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8786380e-89bf-4e56-a1e7-611786d4786a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:33.271351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8786380e-89bf-4e56-a1e7-611786d4786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:33.280883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 679/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:33.327341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff5db-9189-4ca3-b4d3-2bb5e0147aeb None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:33.327626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff5db-9189-4ca3-b4d3-2bb5e0147aeb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:33.327903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff5db-9189-4ca3-b4d3-2bb5e0147aeb None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:33.329350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 687/1366] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 09:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:33.335311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951b3f-9ce8-4cda-85c3-95f869fc09a1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:33.335604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951b3f-9ce8-4cda-85c3-95f869fc09a1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:33.335884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa951b3f-9ce8-4cda-85c3-95f869fc09a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:33.354325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aa951b3f-9ce8-4cda-85c3-95f869fc09a1 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:33.355447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aa951b3f-9ce8-4cda-85c3-95f869fc09a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:33.364870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 680/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 09:51:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:33.372646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff5db-9189-4ca3-b4d3-2bb5e0147aeb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:33.388229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edff5db-9189-4ca3-b4d3-2bb5e0147aeb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:33.393580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc6fb8-61c8-4ec0-ba9f-2c0d6ed6ede6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:33.394212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6fb8-61c8-4ec0-ba9f-2c0d6ed6ede6 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:33.394494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6fb8-61c8-4ec0-ba9f-2c0d6ed6ede6 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:33.394769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6fb8-61c8-4ec0-ba9f-2c0d6ed6ede6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:33.403627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc6fb8-61c8-4ec0-ba9f-2c0d6ed6ede6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:33.405248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc6fb8-61c8-4ec0-ba9f-2c0d6ed6ede6 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:33.415324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 688/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:35.499878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3492c0-b592-4664-8ece-23d1db8026c3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:35.500462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3492c0-b592-4664-8ece-23d1db8026c3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:35.500462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3492c0-b592-4664-8ece-23d1db8026c3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:35.501839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 681/1369] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:35.507082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10183ce-deb1-44e6-85a4-3ad850a7a09e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:35.507821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10183ce-deb1-44e6-85a4-3ad850a7a09e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:35.508316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10183ce-deb1-44e6-85a4-3ad850a7a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:35.527349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c10183ce-deb1-44e6-85a4-3ad850a7a09e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:35.528849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c10183ce-deb1-44e6-85a4-3ad850a7a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:35.537450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 689/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:35.583402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3492c0-b592-4664-8ece-23d1db8026c3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:35.599276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3492c0-b592-4664-8ece-23d1db8026c3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:35.605140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea387840-bcc5-4c8f-90be-08b35805ef1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:35.605799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387840-bcc5-4c8f-90be-08b35805ef1b service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:35.606103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387840-bcc5-4c8f-90be-08b35805ef1b service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:35.606358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea387840-bcc5-4c8f-90be-08b35805ef1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:35.615842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387840-bcc5-4c8f-90be-08b35805ef1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:35.617456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea387840-bcc5-4c8f-90be-08b35805ef1b service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:35.627406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 682/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:36.321759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1be1-c9af-41d5-bd6d-cdba84d60926 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:36.322040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1be1-c9af-41d5-bd6d-cdba84d60926 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:36.322491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde1be1-c9af-41d5-bd6d-cdba84d60926 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:36.324057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 690/1372] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:36.329532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88625e79-0eca-4b69-9f5c-2b0c3e3485f1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:36.329990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88625e79-0eca-4b69-9f5c-2b0c3e3485f1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:36.330278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88625e79-0eca-4b69-9f5c-2b0c3e3485f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:36.349417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-88625e79-0eca-4b69-9f5c-2b0c3e3485f1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:36.350720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-88625e79-0eca-4b69-9f5c-2b0c3e3485f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:36.360239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 683/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:36.721244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeedee-fee4-4911-968a-560ba1d512ba None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:36.721775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeedee-fee4-4911-968a-560ba1d512ba None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:36.721775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeedee-fee4-4911-968a-560ba1d512ba None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:36.723311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 691/1374] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jun 21 09:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:36.728778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f0f4-5160-4b0f-8f1c-4038d5ab999d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:36.729295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f0f4-5160-4b0f-8f1c-4038d5ab999d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:36.729459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8f0f4-5160-4b0f-8f1c-4038d5ab999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:36.781488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-41b8f0f4-5160-4b0f-8f1c-4038d5ab999d None None] MFA Rules not processed for user `bb8e8cab0c654fc39a73caa7c718ae56`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:36.782881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-41b8f0f4-5160-4b0f-8f1c-4038d5ab999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:36.850896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 684/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jun 21 09:51:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:36.858959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeedee-fee4-4911-968a-560ba1d512ba None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:36.870201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aeedee-fee4-4911-968a-560ba1d512ba None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:36.873838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab032e-a926-4534-aa1d-8b81c1313a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:36.874573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab032e-a926-4534-aa1d-8b81c1313a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:36.874956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab032e-a926-4534-aa1d-8b81c1313a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:36.875373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab032e-a926-4534-aa1d-8b81c1313a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:36.885259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab032e-a926-4534-aa1d-8b81c1313a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:36.886828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab032e-a926-4534-aa1d-8b81c1313a50 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:36.896721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 692/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:37.737890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4793-a94d-4580-b666-3174a3308997 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:37.738414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4793-a94d-4580-b666-3174a3308997 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:37.738752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae4793-a94d-4580-b666-3174a3308997 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:37.741278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 685/1377] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:37.746633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9343d8e-1c08-4791-beaf-2bdb4c631cb2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:37.747427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9343d8e-1c08-4791-beaf-2bdb4c631cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:37.747699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9343d8e-1c08-4791-beaf-2bdb4c631cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:37.766478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a9343d8e-1c08-4791-beaf-2bdb4c631cb2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:37.767944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a9343d8e-1c08-4791-beaf-2bdb4c631cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:37.775909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 693/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:51:37.819431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae4793-a94d-4580-b666-3174a3308997 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:37.833897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae4793-a94d-4580-b666-3174a3308997 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:37.839190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f799b-159d-4e21-bb73-48f424eea794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:37.839819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f799b-159d-4e21-bb73-48f424eea794 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:37.840136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f799b-159d-4e21-bb73-48f424eea794 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:37.840412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f799b-159d-4e21-bb73-48f424eea794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:37.849166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f799b-159d-4e21-bb73-48f424eea794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:37.851429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f799b-159d-4e21-bb73-48f424eea794 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:37.856280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:37.862913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 686/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:39.918746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dc3c-77c7-4b95-b9ed-47ae39f0a1c9 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:39.919208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dc3c-77c7-4b95-b9ed-47ae39f0a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:39.919208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dc3c-77c7-4b95-b9ed-47ae39f0a1c9 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:39.921005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 694/1380] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:39.926303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aad532-fafc-45ea-9db1-6a88dc5e9753 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:39.927368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aad532-fafc-45ea-9db1-6a88dc5e9753 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:39.927458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aad532-fafc-45ea-9db1-6a88dc5e9753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:39.945096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-26aad532-fafc-45ea-9db1-6a88dc5e9753 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:39.946387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-26aad532-fafc-45ea-9db1-6a88dc5e9753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:39.954241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 687/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:39.998358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dc3c-77c7-4b95-b9ed-47ae39f0a1c9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:40.012425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dc3c-77c7-4b95-b9ed-47ae39f0a1c9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:40.017730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff517d84-6e1b-40c6-a996-8dc3dbde7a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:40.018349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff517d84-6e1b-40c6-a996-8dc3dbde7a70 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:40.018639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff517d84-6e1b-40c6-a996-8dc3dbde7a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:40.018908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff517d84-6e1b-40c6-a996-8dc3dbde7a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:40.026829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff517d84-6e1b-40c6-a996-8dc3dbde7a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:40.028420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff517d84-6e1b-40c6-a996-8dc3dbde7a70 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:40.038247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 695/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:42.121174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7a98-d4ab-49a5-86e4-fc547308939c None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:42.122040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7a98-d4ab-49a5-86e4-fc547308939c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:42.122325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d7a98-d4ab-49a5-86e4-fc547308939c None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:42.123724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 688/1383] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:42.129042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f50b2-d4a8-4a92-a254-0ad8a3742706 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:42.129485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f50b2-d4a8-4a92-a254-0ad8a3742706 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:42.129599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f50b2-d4a8-4a92-a254-0ad8a3742706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:42.147840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d49f50b2-d4a8-4a92-a254-0ad8a3742706 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:42.149063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d49f50b2-d4a8-4a92-a254-0ad8a3742706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:42.156872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 696/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:42.198281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7a98-d4ab-49a5-86e4-fc547308939c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:42.215569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d7a98-d4ab-49a5-86e4-fc547308939c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:42.221424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e32416-3f7b-457d-95f2-b07da2c6ebcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:42.222087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e32416-3f7b-457d-95f2-b07da2c6ebcd service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:42.222400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e32416-3f7b-457d-95f2-b07da2c6ebcd service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:42.222854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e32416-3f7b-457d-95f2-b07da2c6ebcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:42.232376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e32416-3f7b-457d-95f2-b07da2c6ebcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:42.233977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e32416-3f7b-457d-95f2-b07da2c6ebcd service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:42.245949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 689/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:44.298214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ae6d-b493-4163-b7a4-8c0526756fb4 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:44.298214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ae6d-b493-4163-b7a4-8c0526756fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:44.298214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772ae6d-b493-4163-b7a4-8c0526756fb4 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:44.304789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744175-994b-40a7-952c-60914d0f8835 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:44.304789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744175-994b-40a7-952c-60914d0f8835 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:44.305529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b744175-994b-40a7-952c-60914d0f8835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:44.307035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 697/1386] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:44.331995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7b744175-994b-40a7-952c-60914d0f8835 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:44.333743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7b744175-994b-40a7-952c-60914d0f8835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:44.341864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 690/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:51:44.388065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ae6d-b493-4163-b7a4-8c0526756fb4 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:44.403298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b772ae6d-b493-4163-b7a4-8c0526756fb4 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:44.408922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c5162-3ed9-466e-a442-19dd643eb1f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:44.409558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5162-3ed9-466e-a442-19dd643eb1f2 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:44.409844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5162-3ed9-466e-a442-19dd643eb1f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:44.410117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c5162-3ed9-466e-a442-19dd643eb1f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:44.419216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c5162-3ed9-466e-a442-19dd643eb1f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:44.420890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c5162-3ed9-466e-a442-19dd643eb1f2 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:44.430442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 698/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:46.475327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcec56-5ce9-4ea1-b0f6-7e089b22287a None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:46.475850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcec56-5ce9-4ea1-b0f6-7e089b22287a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:46.475966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcec56-5ce9-4ea1-b0f6-7e089b22287a None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:46.477660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 691/1389] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:46.484135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68369d7-1fc8-4884-8945-295d6346eb1a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:46.484576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68369d7-1fc8-4884-8945-295d6346eb1a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:46.484696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68369d7-1fc8-4884-8945-295d6346eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:46.502481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f68369d7-1fc8-4884-8945-295d6346eb1a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:46.503675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f68369d7-1fc8-4884-8945-295d6346eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:46.513671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 699/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:46.568519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcec56-5ce9-4ea1-b0f6-7e089b22287a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:46.586985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcec56-5ce9-4ea1-b0f6-7e089b22287a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:46.593848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e671d19-593d-4f70-a954-2044c03f8285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:46.594629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671d19-593d-4f70-a954-2044c03f8285 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:46.594977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671d19-593d-4f70-a954-2044c03f8285 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:46.595337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e671d19-593d-4f70-a954-2044c03f8285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:46.606472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e671d19-593d-4f70-a954-2044c03f8285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:46.608583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e671d19-593d-4f70-a954-2044c03f8285 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:46.620354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 692/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:48.736156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075efc-27fb-4ee8-8aeb-6c921e84e7f3 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:48.736772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075efc-27fb-4ee8-8aeb-6c921e84e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:48.736883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb075efc-27fb-4ee8-8aeb-6c921e84e7f3 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:48.738709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 700/1392] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:48.744769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31155b-a944-447f-b9cd-ff1501526e30 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:48.745179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31155b-a944-447f-b9cd-ff1501526e30 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:48.745490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31155b-a944-447f-b9cd-ff1501526e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:48.767783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9d31155b-a944-447f-b9cd-ff1501526e30 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:48.769389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9d31155b-a944-447f-b9cd-ff1501526e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:48.779333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 693/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:48.835345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075efc-27fb-4ee8-8aeb-6c921e84e7f3 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:48.850556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb075efc-27fb-4ee8-8aeb-6c921e84e7f3 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:48.856600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4db7c-a321-4768-8bdc-6575aafe859b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:48.857272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4db7c-a321-4768-8bdc-6575aafe859b service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:48.857577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4db7c-a321-4768-8bdc-6575aafe859b service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:48.857901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4db7c-a321-4768-8bdc-6575aafe859b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:48.867162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4db7c-a321-4768-8bdc-6575aafe859b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:48.868912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4db7c-a321-4768-8bdc-6575aafe859b service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:48.878891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 701/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:50.915846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efdb7c-2ca7-42fd-bd78-c0ad0c17df9f None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:50.916517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efdb7c-2ca7-42fd-bd78-c0ad0c17df9f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:50.916517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efdb7c-2ca7-42fd-bd78-c0ad0c17df9f None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:50.917846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 694/1395] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:50.923282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacda1e-0d83-4a86-9979-f8eb27c91ae7 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:50.923706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacda1e-0d83-4a86-9979-f8eb27c91ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:50.923928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacda1e-0d83-4a86-9979-f8eb27c91ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:50.941844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5cacda1e-0d83-4a86-9979-f8eb27c91ae7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:50.943662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5cacda1e-0d83-4a86-9979-f8eb27c91ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:50.951676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 702/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:50.995168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efdb7c-2ca7-42fd-bd78-c0ad0c17df9f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:51.010155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efdb7c-2ca7-42fd-bd78-c0ad0c17df9f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:51.015428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d098b-9d8d-4962-8493-c17316d19235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:51.016097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d098b-9d8d-4962-8493-c17316d19235 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:51.016382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d098b-9d8d-4962-8493-c17316d19235 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:51.016683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d098b-9d8d-4962-8493-c17316d19235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:51.025028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d098b-9d8d-4962-8493-c17316d19235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:51.026609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d098b-9d8d-4962-8493-c17316d19235 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:51.037360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 695/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:51.966884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985ce3b-6566-4d6f-a6cd-c946a90af182 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:51.967473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985ce3b-6566-4d6f-a6cd-c946a90af182 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:51.967473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985ce3b-6566-4d6f-a6cd-c946a90af182 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:51.968845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 703/1398] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:51.973937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9c27-8d7f-42c5-96a9-99026cda4328 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:51.974384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9c27-8d7f-42c5-96a9-99026cda4328 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:51.974510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d9c27-8d7f-42c5-96a9-99026cda4328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:51.992174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5c0d9c27-8d7f-42c5-96a9-99026cda4328 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:51.993382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5c0d9c27-8d7f-42c5-96a9-99026cda4328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:52.001371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 696/1399] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:52.056863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b413f8-919f-4d20-b1ee-2e842058ee17 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:52.057153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b413f8-919f-4d20-b1ee-2e842058ee17 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:52.057432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b413f8-919f-4d20-b1ee-2e842058ee17 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:52.058793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 704/1400] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jun 21 09:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:52.063799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ffac7-ca6b-4bf8-b696-85a2b7a2d316 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:52.064121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ffac7-ca6b-4bf8-b696-85a2b7a2d316 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:52.064406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ffac7-ca6b-4bf8-b696-85a2b7a2d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:52.117499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8e7ffac7-ca6b-4bf8-b696-85a2b7a2d316 None None] MFA Rules not processed for user `8c7daa59378346bb9466961ea4c7c447`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:52.118701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8e7ffac7-ca6b-4bf8-b696-85a2b7a2d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:52.180813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 697/1401] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jun 21 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:51:52.188337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b413f8-919f-4d20-b1ee-2e842058ee17 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:52.199101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b413f8-919f-4d20-b1ee-2e842058ee17 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:52.202522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c67467-af68-480b-af2d-4d4e0c4a3779 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:52.203159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67467-af68-480b-af2d-4d4e0c4a3779 service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:52.203428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67467-af68-480b-af2d-4d4e0c4a3779 service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:52.203785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c67467-af68-480b-af2d-4d4e0c4a3779 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:52.213154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c67467-af68-480b-af2d-4d4e0c4a3779 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:52.214565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c67467-af68-480b-af2d-4d4e0c4a3779 service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:52.224077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 705/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:51:52.933788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682e34-324e-49af-be96-da7ab8e4860b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:52.934082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682e34-324e-49af-be96-da7ab8e4860b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:52.934365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0682e34-324e-49af-be96-da7ab8e4860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:52.983211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c0682e34-324e-49af-be96-da7ab8e4860b None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:52.984977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c0682e34-324e-49af-be96-da7ab8e4860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:53.024098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:53.047946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 698/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 09:51:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:53.093126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d2233-99e0-4ebc-b92a-a825158d7ec0 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:53.093673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d2233-99e0-4ebc-b92a-a825158d7ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:53.093673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d2233-99e0-4ebc-b92a-a825158d7ec0 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:53.095367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 706/1404] 10.222.0.36 () {54 vars in 942 bytes} [Tue Jun 21 09:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:51:53.096408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9191f-930b-4d2a-ad1d-25cbc72becc3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:53.096741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9191f-930b-4d2a-ad1d-25cbc72becc3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:53.096988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9191f-930b-4d2a-ad1d-25cbc72becc3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:53.099214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 699/1405] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:51:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:51:53.103137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d6e55-4ce1-4442-a9e6-ecf5478ee192 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:53.103427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d6e55-4ce1-4442-a9e6-ecf5478ee192 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:53.103705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d6e55-4ce1-4442-a9e6-ecf5478ee192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:53.104491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:53.104778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:53.105056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:53.123295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:53.124524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:53.132390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 700/1406] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:51:53.155619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a46d6e55-4ce1-4442-a9e6-ecf5478ee192 None None] MFA Rules not processed for user `7f250dc336cc47a0ba8dd4c66ce717ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:51:53.156824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a46d6e55-4ce1-4442-a9e6-ecf5478ee192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:51:53.178535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:53.191050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e4c60-0215-47e7-80fd-ca2e304d4097 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:53.196787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:53.197458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:53.197749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:53.198026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:53.206184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:53.208315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:53.210460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:51:53.217939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 701/1407] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:51:53.233881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 707/1408] 10.222.0.36 () {58 vars in 1039 bytes} [Tue Jun 21 09:51:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:51:53.243500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:51:53.257817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c78500-1f0f-4b3c-8896-01f051849f6d service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:51:53.262820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984ec2-7f33-4812-a4bd-75068cae3e4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:51:53.263453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984ec2-7f33-4812-a4bd-75068cae3e4f service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:51:53.263736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984ec2-7f33-4812-a4bd-75068cae3e4f service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:51:53.264033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984ec2-7f33-4812-a4bd-75068cae3e4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:51:53.272825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2984ec2-7f33-4812-a4bd-75068cae3e4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:51:53.274415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2984ec2-7f33-4812-a4bd-75068cae3e4f service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:51:53.286478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 702/1409] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 09:51:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 09:52:03.230483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:03.282323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=24 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:15.311362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1c8fb-38d4-43cc-8295-da2941142665 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:15.311918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1c8fb-38d4-43cc-8295-da2941142665 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:15.311918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1c8fb-38d4-43cc-8295-da2941142665 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:15.313317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 708/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jun 21 09:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:15.318992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1b0e-9bd0-4dd7-8b63-841e14f90dc8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:15.319451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1b0e-9bd0-4dd7-8b63-841e14f90dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:15.319559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e1b0e-9bd0-4dd7-8b63-841e14f90dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:15.338858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-460e1b0e-9bd0-4dd7-8b63-841e14f90dc8 None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:15.340086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-460e1b0e-9bd0-4dd7-8b63-841e14f90dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:15.348505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 703/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jun 21 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:52:15.362800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3fb34-e9ba-46f7-b91c-014ae0f7efac None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:15.363076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3fb34-e9ba-46f7-b91c-014ae0f7efac None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:15.363353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3fb34-e9ba-46f7-b91c-014ae0f7efac None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:15.364793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 709/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue Jun 21 09:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:15.369453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920164e6-a9ba-46cf-94fa-f2e002663f38 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:15.369739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920164e6-a9ba-46cf-94fa-f2e002663f38 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:15.370012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920164e6-a9ba-46cf-94fa-f2e002663f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:15.387722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-920164e6-a9ba-46cf-94fa-f2e002663f38 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:15.388952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-920164e6-a9ba-46cf-94fa-f2e002663f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:15.398595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 704/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jun 21 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:52:17.859125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977dab-d7bd-4887-89e1-0cfdc9923761 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:17.859540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977dab-d7bd-4887-89e1-0cfdc9923761 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:17.859634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e977dab-d7bd-4887-89e1-0cfdc9923761 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:17.861033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:17.866145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f102-ea88-43fd-ae22-967ceee0c2a0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:17.866564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f102-ea88-43fd-ae22-967ceee0c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:17.866700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38f102-ea88-43fd-ae22-967ceee0c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:17.883696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1a38f102-ea88-43fd-ae22-967ceee0c2a0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:17.884909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1a38f102-ea88-43fd-ae22-967ceee0c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:17.892603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:17.935559 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977dab-d7bd-4887-89e1-0cfdc9923761 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:17.950779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e977dab-d7bd-4887-89e1-0cfdc9923761 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:17.956211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9948d1e-e54f-49a4-ac46-955c9371bbb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:17.956841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9948d1e-e54f-49a4-ac46-955c9371bbb3 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:17.957123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9948d1e-e54f-49a4-ac46-955c9371bbb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:17.957401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9948d1e-e54f-49a4-ac46-955c9371bbb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:17.965891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9948d1e-e54f-49a4-ac46-955c9371bbb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:17.967466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9948d1e-e54f-49a4-ac46-955c9371bbb3 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:17.977373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 711/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:18.865818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f181-6cb6-4e02-93e3-6b5b61b79e12 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:18.866118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f181-6cb6-4e02-93e3-6b5b61b79e12 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:18.866403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f181-6cb6-4e02-93e3-6b5b61b79e12 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:18.867847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:18.872823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33aa68-83a5-4beb-b781-5e89a10d6441 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:18.873235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33aa68-83a5-4beb-b781-5e89a10d6441 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:18.873427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33aa68-83a5-4beb-b781-5e89a10d6441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:18.891033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-1e33aa68-83a5-4beb-b781-5e89a10d6441 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:18.892249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1e33aa68-83a5-4beb-b781-5e89a10d6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:18.900871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:19.049638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f181-6cb6-4e02-93e3-6b5b61b79e12 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:19.063843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f181-6cb6-4e02-93e3-6b5b61b79e12 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:19.069745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665481c-4f8f-4dd8-858f-09aa55112de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:19.070372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665481c-4f8f-4dd8-858f-09aa55112de6 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:19.070659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665481c-4f8f-4dd8-858f-09aa55112de6 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:19.070937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665481c-4f8f-4dd8-858f-09aa55112de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:19.078923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665481c-4f8f-4dd8-858f-09aa55112de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:19.080533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665481c-4f8f-4dd8-858f-09aa55112de6 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:19.090644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 707/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:19.960045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e09b00-4a4d-4081-882d-64a4d4ef3172 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:19.960607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e09b00-4a4d-4081-882d-64a4d4ef3172 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:19.960607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e09b00-4a4d-4081-882d-64a4d4ef3172 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:19.961968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:19.966741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d21b-e366-4860-b8e1-da9b644c5a20 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:19.967194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d21b-e366-4860-b8e1-da9b644c5a20 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:19.967299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8d21b-e366-4860-b8e1-da9b644c5a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:19.985883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-eee8d21b-e366-4860-b8e1-da9b644c5a20 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:19.987100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-eee8d21b-e366-4860-b8e1-da9b644c5a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:19.995393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:20.146317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e09b00-4a4d-4081-882d-64a4d4ef3172 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:20.160480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e09b00-4a4d-4081-882d-64a4d4ef3172 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:20.166450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa353a46-5d7f-4485-a621-82cbe69e3a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:20.167084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa353a46-5d7f-4485-a621-82cbe69e3a21 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:20.167372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa353a46-5d7f-4485-a621-82cbe69e3a21 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:20.167655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa353a46-5d7f-4485-a621-82cbe69e3a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:20.175620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa353a46-5d7f-4485-a621-82cbe69e3a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:20.177222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa353a46-5d7f-4485-a621-82cbe69e3a21 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:20.186530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 714/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:21.035275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478197-6c8c-4c9e-8e39-040fcfc3f864 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:21.036493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478197-6c8c-4c9e-8e39-040fcfc3f864 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:21.036493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478197-6c8c-4c9e-8e39-040fcfc3f864 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:21.037920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:21.042737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945148ff-87e6-4bd0-8f34-3ea5e2207177 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:21.043147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945148ff-87e6-4bd0-8f34-3ea5e2207177 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:21.043297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945148ff-87e6-4bd0-8f34-3ea5e2207177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:21.060865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-945148ff-87e6-4bd0-8f34-3ea5e2207177 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:21.062051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-945148ff-87e6-4bd0-8f34-3ea5e2207177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:21.069813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:21.219562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75478197-6c8c-4c9e-8e39-040fcfc3f864 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:21.234265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75478197-6c8c-4c9e-8e39-040fcfc3f864 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:21.240391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a7c7c-3ca9-4d4c-8327-047b1a07259f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:21.241023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7c7c-3ca9-4d4c-8327-047b1a07259f service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:21.241312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7c7c-3ca9-4d4c-8327-047b1a07259f service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:21.241592 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a7c7c-3ca9-4d4c-8327-047b1a07259f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:21.249556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7c7c-3ca9-4d4c-8327-047b1a07259f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:21.251126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a7c7c-3ca9-4d4c-8327-047b1a07259f service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:21.260962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 710/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:22.115250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed2636-4bd4-4531-b62e-df949ad467f4 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:22.115678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed2636-4bd4-4531-b62e-df949ad467f4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:22.115790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed2636-4bd4-4531-b62e-df949ad467f4 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:22.117204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:22.122136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a6bc-b6e3-48fe-9b49-22ded757ecbd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:22.122544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a6bc-b6e3-48fe-9b49-22ded757ecbd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:22.122703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24a6bc-b6e3-48fe-9b49-22ded757ecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:22.140456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ab24a6bc-b6e3-48fe-9b49-22ded757ecbd None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:22.141663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ab24a6bc-b6e3-48fe-9b49-22ded757ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:22.149535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:22.300276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed2636-4bd4-4531-b62e-df949ad467f4 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:22.315135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed2636-4bd4-4531-b62e-df949ad467f4 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:22.320591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49825-498d-49ca-98a7-e6edc1b57de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:22.321255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49825-498d-49ca-98a7-e6edc1b57de0 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:22.321537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49825-498d-49ca-98a7-e6edc1b57de0 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:22.321812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49825-498d-49ca-98a7-e6edc1b57de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:22.330046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49825-498d-49ca-98a7-e6edc1b57de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:22.331609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49825-498d-49ca-98a7-e6edc1b57de0 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:22.341402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 717/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:23.149349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258924f-2ff5-4ae6-b822-af1fd1e3d9fa None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:23.149968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258924f-2ff5-4ae6-b822-af1fd1e3d9fa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:23.149968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258924f-2ff5-4ae6-b822-af1fd1e3d9fa None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:23.151295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:23.156173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d09c8-e807-4a92-8276-92a434ddc4fd None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:23.156570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d09c8-e807-4a92-8276-92a434ddc4fd None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:23.156742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d09c8-e807-4a92-8276-92a434ddc4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:23.174749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0c5d09c8-e807-4a92-8276-92a434ddc4fd None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:23.175919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0c5d09c8-e807-4a92-8276-92a434ddc4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:23.183581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:52:23.332670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258924f-2ff5-4ae6-b822-af1fd1e3d9fa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:23.347047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258924f-2ff5-4ae6-b822-af1fd1e3d9fa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:23.352521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d314-ae20-405a-ae19-dc15e09ca250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:23.353363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d314-ae20-405a-ae19-dc15e09ca250 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:23.353648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d314-ae20-405a-ae19-dc15e09ca250 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:23.353925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d314-ae20-405a-ae19-dc15e09ca250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:23.362040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84d314-ae20-405a-ae19-dc15e09ca250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:23.363610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84d314-ae20-405a-ae19-dc15e09ca250 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:23.373452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 713/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:24.178908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376853e8-750a-495e-97c2-fd3a93d8bc3c None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:24.179436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376853e8-750a-495e-97c2-fd3a93d8bc3c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:24.179436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376853e8-750a-495e-97c2-fd3a93d8bc3c None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:24.180842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:24.185794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ec50c-faca-4479-b218-e161faa1075a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:24.186219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ec50c-faca-4479-b218-e161faa1075a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:24.186391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ec50c-faca-4479-b218-e161faa1075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:24.204825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-637ec50c-faca-4479-b218-e161faa1075a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:24.206020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-637ec50c-faca-4479-b218-e161faa1075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:24.214464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:24.364689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376853e8-750a-495e-97c2-fd3a93d8bc3c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:24.379149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376853e8-750a-495e-97c2-fd3a93d8bc3c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:24.385373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9e9a4-9b7f-4d8d-b48d-752f909411ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:24.386021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e9a4-9b7f-4d8d-b48d-752f909411ca service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:24.386311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e9a4-9b7f-4d8d-b48d-752f909411ca service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:24.386579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e9a4-9b7f-4d8d-b48d-752f909411ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:24.395652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9e9a4-9b7f-4d8d-b48d-752f909411ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:24.397287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9e9a4-9b7f-4d8d-b48d-752f909411ca service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:24.406706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 720/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:25.205161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4f51d-269f-4a38-b319-5724f3268788 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:25.205681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4f51d-269f-4a38-b319-5724f3268788 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:25.205777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4f51d-269f-4a38-b319-5724f3268788 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:25.207137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:25.212511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e4b3-11e9-4806-acac-3510594007d2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:25.212951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e4b3-11e9-4806-acac-3510594007d2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:25.213060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e4b3-11e9-4806-acac-3510594007d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:25.231155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f0c6e4b3-11e9-4806-acac-3510594007d2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:25.232368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f0c6e4b3-11e9-4806-acac-3510594007d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:25.240502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:25.389810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4f51d-269f-4a38-b319-5724f3268788 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:25.403773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4f51d-269f-4a38-b319-5724f3268788 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:25.409115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa71327-fae0-44a3-aa0b-ecdfdca088a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:25.409753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71327-fae0-44a3-aa0b-ecdfdca088a2 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:25.410038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71327-fae0-44a3-aa0b-ecdfdca088a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:25.410318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa71327-fae0-44a3-aa0b-ecdfdca088a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:25.418353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71327-fae0-44a3-aa0b-ecdfdca088a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:25.419936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa71327-fae0-44a3-aa0b-ecdfdca088a2 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:25.429724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 716/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:26.227258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46feaff-6693-438d-af80-bd6823737af7 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:26.227810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46feaff-6693-438d-af80-bd6823737af7 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:26.227810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46feaff-6693-438d-af80-bd6823737af7 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:26.229470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:26.234449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06e8d-dbe4-439f-97e6-2d653efef4c5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:26.234873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06e8d-dbe4-439f-97e6-2d653efef4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:26.235000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf06e8d-dbe4-439f-97e6-2d653efef4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:26.252388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9bf06e8d-dbe4-439f-97e6-2d653efef4c5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:26.253556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9bf06e8d-dbe4-439f-97e6-2d653efef4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:26.261089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:26.410196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46feaff-6693-438d-af80-bd6823737af7 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:26.424585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46feaff-6693-438d-af80-bd6823737af7 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:26.429804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21489e7f-8816-47cd-8200-ec3ce737a2b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:26.430420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489e7f-8816-47cd-8200-ec3ce737a2b1 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:26.430700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489e7f-8816-47cd-8200-ec3ce737a2b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:26.430971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21489e7f-8816-47cd-8200-ec3ce737a2b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:26.438711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489e7f-8816-47cd-8200-ec3ce737a2b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:26.440316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21489e7f-8816-47cd-8200-ec3ce737a2b1 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:26.449826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 723/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:28.365986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133aafd-18fd-46bc-89e7-416e62a4aab8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:28.366551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133aafd-18fd-46bc-89e7-416e62a4aab8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:28.366551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133aafd-18fd-46bc-89e7-416e62a4aab8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:28.367814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:52:28.373052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f506383-a7ef-4774-ad0e-adc38ae4a3e6 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:28.373452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f506383-a7ef-4774-ad0e-adc38ae4a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:28.373602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f506383-a7ef-4774-ad0e-adc38ae4a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:28.392384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7f506383-a7ef-4774-ad0e-adc38ae4a3e6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:28.393564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7f506383-a7ef-4774-ad0e-adc38ae4a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:28.401271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:28.439270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133aafd-18fd-46bc-89e7-416e62a4aab8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:28.450424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133aafd-18fd-46bc-89e7-416e62a4aab8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:28.453889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b48d8-a525-4795-83e4-6d7b0a3fcdf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:28.454510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b48d8-a525-4795-83e4-6d7b0a3fcdf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:28.454790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b48d8-a525-4795-83e4-6d7b0a3fcdf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:28.455067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b48d8-a525-4795-83e4-6d7b0a3fcdf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:28.463628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b48d8-a525-4795-83e4-6d7b0a3fcdf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:28.465077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b48d8-a525-4795-83e4-6d7b0a3fcdf7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:28.474163 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 719/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:30.633340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e6bf-2219-4d65-9972-8b30ba2a2074 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:30.633896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e6bf-2219-4d65-9972-8b30ba2a2074 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:30.633896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2e6bf-2219-4d65-9972-8b30ba2a2074 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:30.635270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:30.640526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb9693-eac8-4ae4-b3b1-e8d1ffa50b12 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:30.640952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb9693-eac8-4ae4-b3b1-e8d1ffa50b12 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:30.641097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb9693-eac8-4ae4-b3b1-e8d1ffa50b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:30.658836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-42cb9693-eac8-4ae4-b3b1-e8d1ffa50b12 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:30.660050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-42cb9693-eac8-4ae4-b3b1-e8d1ffa50b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:30.668370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:30.705227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e6bf-2219-4d65-9972-8b30ba2a2074 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:30.716179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2e6bf-2219-4d65-9972-8b30ba2a2074 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:30.719629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3daaaf3-6654-4195-87ab-01676ecaff3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:30.720286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daaaf3-6654-4195-87ab-01676ecaff3d service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:30.720565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daaaf3-6654-4195-87ab-01676ecaff3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:30.720840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3daaaf3-6654-4195-87ab-01676ecaff3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:30.730413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daaaf3-6654-4195-87ab-01676ecaff3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:30.731826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3daaaf3-6654-4195-87ab-01676ecaff3d service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:30.741218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 726/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:33.047128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4766-224e-4537-8181-af6eeb9315d2 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:33.047668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4766-224e-4537-8181-af6eeb9315d2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:33.047668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db4766-224e-4537-8181-af6eeb9315d2 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:33.049121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:33.054307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d1fe-7ecf-4386-b53d-763ff9a77943 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:33.054709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d1fe-7ecf-4386-b53d-763ff9a77943 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:33.054854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d1fe-7ecf-4386-b53d-763ff9a77943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:33.071965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e512d1fe-7ecf-4386-b53d-763ff9a77943 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:33.073158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e512d1fe-7ecf-4386-b53d-763ff9a77943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:33.080708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:33.119717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4766-224e-4537-8181-af6eeb9315d2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:33.130444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db4766-224e-4537-8181-af6eeb9315d2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:33.133989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7426d2-295f-43db-bfb5-2afea160aef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:33.134622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7426d2-295f-43db-bfb5-2afea160aef9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:33.134905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7426d2-295f-43db-bfb5-2afea160aef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:33.135183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7426d2-295f-43db-bfb5-2afea160aef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:33.144129 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7426d2-295f-43db-bfb5-2afea160aef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:33.146070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7426d2-295f-43db-bfb5-2afea160aef9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:33.155515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 722/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:35.282260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e175d-f285-4084-bada-51b5d54e836e None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:35.282737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e175d-f285-4084-bada-51b5d54e836e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:35.282830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e175d-f285-4084-bada-51b5d54e836e None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:35.284214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:35.290033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c3a25-c205-4936-838e-a0e1b153c7d3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:35.290457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c3a25-c205-4936-838e-a0e1b153c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:35.290589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c3a25-c205-4936-838e-a0e1b153c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:35.307877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-865c3a25-c205-4936-838e-a0e1b153c7d3 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:35.309121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-865c3a25-c205-4936-838e-a0e1b153c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:35.316844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:35.355254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e175d-f285-4084-bada-51b5d54e836e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:35.365486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e175d-f285-4084-bada-51b5d54e836e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:35.368894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea037f-4e97-42e5-9d4c-9c76c8dde793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:35.369513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea037f-4e97-42e5-9d4c-9c76c8dde793 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:35.369886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea037f-4e97-42e5-9d4c-9c76c8dde793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:35.370159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea037f-4e97-42e5-9d4c-9c76c8dde793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:35.378890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea037f-4e97-42e5-9d4c-9c76c8dde793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:35.380306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea037f-4e97-42e5-9d4c-9c76c8dde793 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:35.389560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 729/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:37.452187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfda6-81b0-4c39-87d8-ff76071e247b None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:37.452735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfda6-81b0-4c39-87d8-ff76071e247b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:37.452735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcfda6-81b0-4c39-87d8-ff76071e247b None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:37.454095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:37.460023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601522-161c-4f05-8692-c68459e00d66 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:37.460427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601522-161c-4f05-8692-c68459e00d66 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:37.460583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b601522-161c-4f05-8692-c68459e00d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:37.478709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0b601522-161c-4f05-8692-c68459e00d66 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:37.479894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0b601522-161c-4f05-8692-c68459e00d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:37.487592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:37.525464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcfda6-81b0-4c39-87d8-ff76071e247b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:37.527134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-12fcfda6-81b0-4c39-87d8-ff76071e247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:37.540345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcfda6-81b0-4c39-87d8-ff76071e247b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:37.543814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5528e1-924a-46b4-b0d6-e0f990449922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:37.544479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5528e1-924a-46b4-b0d6-e0f990449922 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:37.544763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5528e1-924a-46b4-b0d6-e0f990449922 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:37.545039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5528e1-924a-46b4-b0d6-e0f990449922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:37.554069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5528e1-924a-46b4-b0d6-e0f990449922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:37.555479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5528e1-924a-46b4-b0d6-e0f990449922 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:37.565470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 725/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:52:39.730890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb02ae1-dee4-46a7-b228-cdec44214c73 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:39.731426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb02ae1-dee4-46a7-b228-cdec44214c73 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:39.731426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb02ae1-dee4-46a7-b228-cdec44214c73 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:39.732840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:39.739036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58911-42a2-4ac4-ac27-b003b9deba10 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:39.739458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58911-42a2-4ac4-ac27-b003b9deba10 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:39.739595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58911-42a2-4ac4-ac27-b003b9deba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:39.757415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-41a58911-42a2-4ac4-ac27-b003b9deba10 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:39.758588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-41a58911-42a2-4ac4-ac27-b003b9deba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:39.766183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:39.803355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb02ae1-dee4-46a7-b228-cdec44214c73 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:39.813816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb02ae1-dee4-46a7-b228-cdec44214c73 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:39.818035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beff72e-a608-4228-b1c2-39d9642f0b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:39.818661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff72e-a608-4228-b1c2-39d9642f0b9b service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:39.818939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff72e-a608-4228-b1c2-39d9642f0b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:39.819241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beff72e-a608-4228-b1c2-39d9642f0b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:39.827957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff72e-a608-4228-b1c2-39d9642f0b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:39.829406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beff72e-a608-4228-b1c2-39d9642f0b9b service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:39.838593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 732/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:41.917398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121eb13-c1e7-48ef-989a-d53963dccac3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:41.917936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121eb13-c1e7-48ef-989a-d53963dccac3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:41.917936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121eb13-c1e7-48ef-989a-d53963dccac3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:41.919346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:41.924536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2529e1-c1dd-401e-8ef0-c0ea783f3e5d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:41.924991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2529e1-c1dd-401e-8ef0-c0ea783f3e5d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:41.925088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2529e1-c1dd-401e-8ef0-c0ea783f3e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:41.942245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5d2529e1-c1dd-401e-8ef0-c0ea783f3e5d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:41.943421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5d2529e1-c1dd-401e-8ef0-c0ea783f3e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:41.951057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:41.988938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121eb13-c1e7-48ef-989a-d53963dccac3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:41.999469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121eb13-c1e7-48ef-989a-d53963dccac3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:42.002893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40feca12-f3ac-4010-985e-bb11692463d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:42.003515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feca12-f3ac-4010-985e-bb11692463d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:42.003795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feca12-f3ac-4010-985e-bb11692463d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:42.004103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40feca12-f3ac-4010-985e-bb11692463d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:42.012721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40feca12-f3ac-4010-985e-bb11692463d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:42.014131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40feca12-f3ac-4010-985e-bb11692463d0 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:42.023689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 728/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:44.083432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586a92-ee72-49b5-b8bc-aa934fb101b7 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:44.084043 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586a92-ee72-49b5-b8bc-aa934fb101b7 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:44.084043 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6586a92-ee72-49b5-b8bc-aa934fb101b7 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:44.085381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:44.090615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0dbbe-4f2f-40d9-8a61-4ee610caf516 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:44.091043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0dbbe-4f2f-40d9-8a61-4ee610caf516 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:44.091170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0dbbe-4f2f-40d9-8a61-4ee610caf516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:44.097233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=79 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:44.110031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-62c0dbbe-4f2f-40d9-8a61-4ee610caf516 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:44.111225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62c0dbbe-4f2f-40d9-8a61-4ee610caf516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:44.119491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:44.156714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6586a92-ee72-49b5-b8bc-aa934fb101b7 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:44.162149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=73 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:44.168489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6586a92-ee72-49b5-b8bc-aa934fb101b7 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:44.172021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20986c76-1a5b-433b-9b3f-2ec2c31ae568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:44.172662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986c76-1a5b-433b-9b3f-2ec2c31ae568 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:44.172946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986c76-1a5b-433b-9b3f-2ec2c31ae568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:44.173225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20986c76-1a5b-433b-9b3f-2ec2c31ae568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:44.182502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20986c76-1a5b-433b-9b3f-2ec2c31ae568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:44.183930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20986c76-1a5b-433b-9b3f-2ec2c31ae568 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:44.193818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 735/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:46.243936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8ae2-bd6b-4d09-a222-07f02ac0522d None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:46.244484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8ae2-bd6b-4d09-a222-07f02ac0522d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:46.244610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f8ae2-bd6b-4d09-a222-07f02ac0522d None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:46.245896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:46.251405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc2741-bcbb-4ffb-a288-3fcef9408f26 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:46.251800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc2741-bcbb-4ffb-a288-3fcef9408f26 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:46.251963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc2741-bcbb-4ffb-a288-3fcef9408f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:46.270479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3bcc2741-bcbb-4ffb-a288-3fcef9408f26 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:46.271675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3bcc2741-bcbb-4ffb-a288-3fcef9408f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:46.279394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:52:46.315382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8ae2-bd6b-4d09-a222-07f02ac0522d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:46.326346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f8ae2-bd6b-4d09-a222-07f02ac0522d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:46.329803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431f6d2-539d-4111-8979-fd90b32a281a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:46.330428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f6d2-539d-4111-8979-fd90b32a281a service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:46.330711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f6d2-539d-4111-8979-fd90b32a281a service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:46.330987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431f6d2-539d-4111-8979-fd90b32a281a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:46.339745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431f6d2-539d-4111-8979-fd90b32a281a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:46.341198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431f6d2-539d-4111-8979-fd90b32a281a service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:46.350528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 731/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:52:48.386592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37db01-cc90-4705-a468-1abb8e5985f1 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:48.387099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37db01-cc90-4705-a468-1abb8e5985f1 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:48.387099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37db01-cc90-4705-a468-1abb8e5985f1 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:48.388448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:52:48.393585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604dd60-1774-4487-b33c-4c1fa714e3ab None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:48.394009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604dd60-1774-4487-b33c-4c1fa714e3ab None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:48.394149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604dd60-1774-4487-b33c-4c1fa714e3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:48.412709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9604dd60-1774-4487-b33c-4c1fa714e3ab None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:52:48.413904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9604dd60-1774-4487-b33c-4c1fa714e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:52:48.421861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:52:48.457609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37db01-cc90-4705-a468-1abb8e5985f1 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:52:48.468063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37db01-cc90-4705-a468-1abb8e5985f1 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:52:48.471486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a559c-398c-43e3-b2ee-35dda89de15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:52:48.472157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a559c-398c-43e3-b2ee-35dda89de15a service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:52:48.472447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a559c-398c-43e3-b2ee-35dda89de15a service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:52:48.473553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a559c-398c-43e3-b2ee-35dda89de15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:52:48.482159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a559c-398c-43e3-b2ee-35dda89de15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:52:48.483581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a559c-398c-43e3-b2ee-35dda89de15a service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:52:48.493530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 738/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:52:58.406529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=11 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:52:58.489223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=14 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:53:08.527084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1790fa-418d-4f84-9c6d-8484d11f2445 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:08.527654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1790fa-418d-4f84-9c6d-8484d11f2445 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:08.527823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1790fa-418d-4f84-9c6d-8484d11f2445 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:08.529266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 733/1471] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:08.534760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177d25-5555-4463-9054-bdabdf05f034 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:08.535755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177d25-5555-4463-9054-bdabdf05f034 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:08.535935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95177d25-5555-4463-9054-bdabdf05f034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:08.553444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-95177d25-5555-4463-9054-bdabdf05f034 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:08.554633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-95177d25-5555-4463-9054-bdabdf05f034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:08.562367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 739/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:08.610187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8adb-1a57-4736-aab4-be524e862660 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:08.610472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8adb-1a57-4736-aab4-be524e862660 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:08.610749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8adb-1a57-4736-aab4-be524e862660 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:08.612132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 734/1473] 10.222.0.36 () {54 vars in 962 bytes} [Tue Jun 21 09:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:08.617102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726290e-18d0-40a2-9567-c49394664b2c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:08.617398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726290e-18d0-40a2-9567-c49394664b2c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:08.617704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726290e-18d0-40a2-9567-c49394664b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:08.635477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3726290e-18d0-40a2-9567-c49394664b2c None None] MFA Rules not processed for user `8c7daa59378346bb9466961ea4c7c447`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:08.636696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3726290e-18d0-40a2-9567-c49394664b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:08.643262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 740/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Jun 21 09:53:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:08.651091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8adb-1a57-4736-aab4-be524e862660 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:08.662103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a8adb-1a57-4736-aab4-be524e862660 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:08.665590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa14b6-fb22-4fd9-9717-62613df9cda1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:08.666212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa14b6-fb22-4fd9-9717-62613df9cda1 service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:08.666496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa14b6-fb22-4fd9-9717-62613df9cda1 service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:08.666774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa14b6-fb22-4fd9-9717-62613df9cda1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:08.675531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa14b6-fb22-4fd9-9717-62613df9cda1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:08.676976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa14b6-fb22-4fd9-9717-62613df9cda1 service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:08.686224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 735/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:53:10.778984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8e4f-5076-446a-ac21-79f87954f03b None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:10.779573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8e4f-5076-446a-ac21-79f87954f03b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:10.779573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8e4f-5076-446a-ac21-79f87954f03b None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:10.780933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 741/1476] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:10.786058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eec14-665f-4537-a77f-efdd25613ff6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:10.786506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eec14-665f-4537-a77f-efdd25613ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:10.786609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73eec14-665f-4537-a77f-efdd25613ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:10.804734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a73eec14-665f-4537-a77f-efdd25613ff6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:10.805937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a73eec14-665f-4537-a77f-efdd25613ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:10.813733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 736/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:10.837259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8e4f-5076-446a-ac21-79f87954f03b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:10.849438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8e4f-5076-446a-ac21-79f87954f03b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:10.854525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:10.855140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:10.855421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:10.855714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:10.856532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:10.858368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:53:10.858368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:53:10.858368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:53:10.859523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc5122-f0c9-4e9f-8055-c0739ba8fc1e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:10.878657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 742/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Jun 21 09:53:10 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:53:12.903713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef2fc2-9e7a-4e6c-887d-7a43aeecd6c8 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:12.904302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef2fc2-9e7a-4e6c-887d-7a43aeecd6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:12.904302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef2fc2-9e7a-4e6c-887d-7a43aeecd6c8 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:12.905659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 737/1479] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:12.910849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f33a-1876-48bc-8d4e-de8cf23d1b30 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:12.911268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f33a-1876-48bc-8d4e-de8cf23d1b30 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:12.911399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42f33a-1876-48bc-8d4e-de8cf23d1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:12.929282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-aa42f33a-1876-48bc-8d4e-de8cf23d1b30 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:12.930467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-aa42f33a-1876-48bc-8d4e-de8cf23d1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:12.938077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 743/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:12.980632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef2fc2-9e7a-4e6c-887d-7a43aeecd6c8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:12.995946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef2fc2-9e7a-4e6c-887d-7a43aeecd6c8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:13.001268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c630a-898c-425c-b5ee-d5429fea4e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:13.001901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c630a-898c-425c-b5ee-d5429fea4e87 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:13.002184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c630a-898c-425c-b5ee-d5429fea4e87 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:13.002461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c630a-898c-425c-b5ee-d5429fea4e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:13.011145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c630a-898c-425c-b5ee-d5429fea4e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:13.012756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c630a-898c-425c-b5ee-d5429fea4e87 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:13.022135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 738/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:53:15.230524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867013-30db-477f-8a9b-d2604b0c398f None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:15.231072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867013-30db-477f-8a9b-d2604b0c398f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:15.231181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867013-30db-477f-8a9b-d2604b0c398f None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:15.232536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 744/1482] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:15.237835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24fc2-c40f-4ce4-a08b-75f3742e9579 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:15.238855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24fc2-c40f-4ce4-a08b-75f3742e9579 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:15.238955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24fc2-c40f-4ce4-a08b-75f3742e9579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:15.256954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-74c24fc2-c40f-4ce4-a08b-75f3742e9579 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:15.258146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-74c24fc2-c40f-4ce4-a08b-75f3742e9579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:15.266243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 739/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:15.301486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0867013-30db-477f-8a9b-d2604b0c398f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:15.312013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0867013-30db-477f-8a9b-d2604b0c398f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:15.315482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6d3fe-af7d-4b8c-8035-a0feec4938df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:15.316135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d3fe-af7d-4b8c-8035-a0feec4938df service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:15.317036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d3fe-af7d-4b8c-8035-a0feec4938df service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:15.317347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6d3fe-af7d-4b8c-8035-a0feec4938df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:15.325940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d3fe-af7d-4b8c-8035-a0feec4938df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:15.327348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6d3fe-af7d-4b8c-8035-a0feec4938df service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:15.336467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 745/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:53:17.414333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50776-28b8-4b7d-bf6b-2a3f2998a674 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:17.414854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50776-28b8-4b7d-bf6b-2a3f2998a674 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:17.414854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a50776-28b8-4b7d-bf6b-2a3f2998a674 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:17.416225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 740/1485] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:17.421394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437a9d-5d99-4c7d-a68b-dbb545fd7b20 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:17.421787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437a9d-5d99-4c7d-a68b-dbb545fd7b20 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:17.421958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437a9d-5d99-4c7d-a68b-dbb545fd7b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:17.440128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c2437a9d-5d99-4c7d-a68b-dbb545fd7b20 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:17.441316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c2437a9d-5d99-4c7d-a68b-dbb545fd7b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:17.449281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 746/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:17.487471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50776-28b8-4b7d-bf6b-2a3f2998a674 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:17.498074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a50776-28b8-4b7d-bf6b-2a3f2998a674 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:17.501544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2137e-12a2-4475-9147-c5796ebaa0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:17.502172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2137e-12a2-4475-9147-c5796ebaa0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:17.502455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2137e-12a2-4475-9147-c5796ebaa0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:17.502731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2137e-12a2-4475-9147-c5796ebaa0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:17.511484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2137e-12a2-4475-9147-c5796ebaa0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:17.512932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2137e-12a2-4475-9147-c5796ebaa0c0 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:17.522637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 741/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:53:19.654943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43315-2a31-470f-a03c-3ed5875970c9 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:19.655537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43315-2a31-470f-a03c-3ed5875970c9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:19.655537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43315-2a31-470f-a03c-3ed5875970c9 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:19.656918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 747/1488] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:19.663457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3585-6244-4114-9ba9-33016738d530 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:19.663904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3585-6244-4114-9ba9-33016738d530 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:19.664115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b3585-6244-4114-9ba9-33016738d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:19.681968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-952b3585-6244-4114-9ba9-33016738d530 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:19.683150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-952b3585-6244-4114-9ba9-33016738d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:19.690814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 742/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:19.732844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43315-2a31-470f-a03c-3ed5875970c9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:19.743738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43315-2a31-470f-a03c-3ed5875970c9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:19.747187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6e2e2-7a09-404f-80be-eb215dfda83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:19.747816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e2e2-7a09-404f-80be-eb215dfda83e service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:19.748134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e2e2-7a09-404f-80be-eb215dfda83e service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:19.748408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6e2e2-7a09-404f-80be-eb215dfda83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:19.757775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6e2e2-7a09-404f-80be-eb215dfda83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:19.759192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6e2e2-7a09-404f-80be-eb215dfda83e service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:19.768341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 748/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:53:21.965169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db49c66-b45b-4569-ba1d-127634c5fd14 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:21.965764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db49c66-b45b-4569-ba1d-127634c5fd14 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:21.965764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db49c66-b45b-4569-ba1d-127634c5fd14 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:21.967143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 743/1491] 10.222.0.36 () {54 vars in 926 bytes} [Tue Jun 21 09:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:53:21.972975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628710f3-eec0-48ac-a72f-cdb557bfb5df None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:21.973379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628710f3-eec0-48ac-a72f-cdb557bfb5df None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:21.973528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628710f3-eec0-48ac-a72f-cdb557bfb5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:21.991359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-628710f3-eec0-48ac-a72f-cdb557bfb5df None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:53:21.992568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-628710f3-eec0-48ac-a72f-cdb557bfb5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:53:22.000231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 749/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Tue Jun 21 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:53:22.038892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db49c66-b45b-4569-ba1d-127634c5fd14 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:53:22.049366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db49c66-b45b-4569-ba1d-127634c5fd14 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:53:22.052832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024d396-02c6-4654-87f3-d44c4fefc3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:53:22.053453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d396-02c6-4654-87f3-d44c4fefc3dd service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:53:22.053734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d396-02c6-4654-87f3-d44c4fefc3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:53:22.054009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024d396-02c6-4654-87f3-d44c4fefc3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:53:22.062646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024d396-02c6-4654-87f3-d44c4fefc3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:53:22.064088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024d396-02c6-4654-87f3-d44c4fefc3dd service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:53:22.073192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 744/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:53:31.986319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=33 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:53:32.069098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=33 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:54:53.603799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.604454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.604454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.622249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:54:53.623431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:53.631242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 750/1494] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:54:53.640444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.641027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.641132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.660664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:54:53.661852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:53.669709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 745/1495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:54:53.674239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:53.683756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2afe9-90c5-49db-80cf-e1c0b7a26650 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:53.688279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:53.688922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.689207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.689484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.690234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:54:53.690540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:53.691542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:53.691542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:54:53.691542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:54:53.692449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:53.703723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 751/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:54:53.712357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:53.721949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ebca-900c-4a0e-bbbe-ba9cca089b37 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:53.726520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:53.727157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.727467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.727743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.728463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:53.730235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:53.730235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:54:53.730235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:54:53.731731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:53.767079 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 746/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:54:53 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:54:53.771839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:53.781571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa23e9-c898-4847-91a6-0a9be23f07a8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:53.837214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:53.837867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.838150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.838425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.839111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:53.840140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:53.840140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:54:53.840140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:54:53.841335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:53.860913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 752/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:54:53 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:54:53.865153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:53.875446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98898-c92e-4048-a278-eab11310d1b8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:53.880407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:53.881080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.881362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.881636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.882361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:53.883360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:53.883360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:54:53.883360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:54:53.884257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:53.897786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 747/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:54:53.901346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:53.911042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38cd60-dfa2-4481-8a49-015aab49da3c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:53.915492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:53.916164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.916446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.916716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.917434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:53.918430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:53.918430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:54:53.918430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:54:53.919291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf4126-7fa0-4da7-8c98-5baad030bf14 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:53.932493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 753/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:54:53.936540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:53.946904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dd5f9-f0d5-43ab-9c39-d7ebac0e6051 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:53.951508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:53.952454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.952739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.953015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] PATH_INFO: `/v3/projects/7a081da5c879446e818a0b46dc61a061/users/c88bbd22ebea4e378c7ab09032612ef0/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:53.968614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a081da5c879446e818a0b46dc61a061, user_id=c88bbd22ebea4e378c7ab09032612ef0, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:53.969647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:53.969647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:54:53.969647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:54:53.971569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2da0-aa7f-440c-943f-49e2610ca3c5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:53.984489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 748/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:54:53 2022] PUT /identity/v3/projects/7a081da5c879446e818a0b46dc61a061/users/c88bbd22ebea4e378c7ab09032612ef0/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:54:53.995795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66b04-c66e-4e4e-acaa-05ea9e76e9a0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:53.996123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66b04-c66e-4e4e-acaa-05ea9e76e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:53.996428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66b04-c66e-4e4e-acaa-05ea9e76e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.022732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c5d66b04-c66e-4e4e-acaa-05ea9e76e9a0 None None] MFA Rules not processed for user `c88bbd22ebea4e378c7ab09032612ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:54:54.023913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c5d66b04-c66e-4e4e-acaa-05ea9e76e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:54.084497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 754/1502] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:54:54.097755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811752-71be-4dfe-a32f-6758176dc9ce None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.098051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811752-71be-4dfe-a32f-6758176dc9ce None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.098328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811752-71be-4dfe-a32f-6758176dc9ce None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.100254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 749/1503] 10.222.0.36 () {54 vars in 963 bytes} [Tue Jun 21 09:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:54:54.104553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73513-95e5-4e40-8300-a6cb079aef3d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.104842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73513-95e5-4e40-8300-a6cb079aef3d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.105118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe73513-95e5-4e40-8300-a6cb079aef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.123130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7fe73513-95e5-4e40-8300-a6cb079aef3d None None] MFA Rules not processed for user `bb8e8cab0c654fc39a73caa7c718ae56`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:54:54.124289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7fe73513-95e5-4e40-8300-a6cb079aef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:54.166838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:54:54.175200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 755/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Tue Jun 21 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:54:54.182583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6811752-71be-4dfe-a32f-6758176dc9ce None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:54.193051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6811752-71be-4dfe-a32f-6758176dc9ce None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:54.196492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:54.197113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.197395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.197668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.206204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:54.207605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:54.216125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 750/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:54:54.257437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9ab86-2418-4d18-8ee4-4e79a85da329 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.257836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9ab86-2418-4d18-8ee4-4e79a85da329 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.258121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9ab86-2418-4d18-8ee4-4e79a85da329 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.259400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 756/1506] 10.222.0.36 () {52 vars in 829 bytes} [Tue Jun 21 09:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:54:54.263130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:54.322853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defe69d-eb01-4b81-b0fe-1d015ed7691e service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:54.327254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:54.328136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.328421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.328696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] PATH_INFO: `/v3/users/c88bbd22ebea4e378c7ab09032612ef0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.329858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88bbd22ebea4e378c7ab09032612ef0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:54.331349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:54.331349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:54:54.331349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:54:54.332581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:54.396385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88bbd22ebea4e378c7ab09032612ef0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:54.415157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88bbd22ebea4e378c7ab09032612ef0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:54.424214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88bbd22ebea4e378c7ab09032612ef0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:54.432708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:54:54.437492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88bbd22ebea4e378c7ab09032612ef0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:54.438211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88bbd22ebea4e378c7ab09032612ef0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:54.444731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 751/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:54:54 2022] DELETE /identity/v3/users/c88bbd22ebea4e378c7ab09032612ef0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:54:54.449109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.449385 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.449661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.467113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:54:54.468334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:54.524656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 757/1508] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:54:54.534623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:54.536045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:54.594057 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0d204-115d-4a7a-b9ab-ea12aa2cfe1d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:54.597646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7700db-155c-4126-a5d8-94201c682072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:54.598292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7700db-155c-4126-a5d8-94201c682072 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.598577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7700db-155c-4126-a5d8-94201c682072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.598853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7700db-155c-4126-a5d8-94201c682072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.611427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7700db-155c-4126-a5d8-94201c682072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:54.612906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7700db-155c-4126-a5d8-94201c682072 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:54.622402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 752/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:54:54.946351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:54:54.947872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:54:54.959836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3ce6f-0261-404a-a22b-63c3553bf72a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:54:54.964531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:54:54.965394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:54:54.965679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:54:54.965956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] PATH_INFO: `/v3/projects/7a081da5c879446e818a0b46dc61a061` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:54:54.967227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a081da5c879446e818a0b46dc61a061)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:54:54.968233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:54:54.968233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:54:54.968233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:54:54.969429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:54:55.029050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a081da5c879446e818a0b46dc61a061', 'request_id': 'req-4ffaaffb-1581-4c9b-a2f2-85767550d56a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:55.042238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a081da5c879446e818a0b46dc61a061', 'request_id': 'req-4ffaaffb-1581-4c9b-a2f2-85767550d56a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:55.051893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a081da5c879446e818a0b46dc61a061', 'request_id': 'req-4ffaaffb-1581-4c9b-a2f2-85767550d56a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:55.062579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] The token cache is being invalidate because project 7a081da5c879446e818a0b46dc61a061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:54:55.062867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:55.063573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4ffaaffb-1581-4c9b-a2f2-85767550d56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:54:55.065796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 758/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:54:54 2022] DELETE /identity/v3/projects/7a081da5c879446e818a0b46dc61a061 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:55:04.618155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=29 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:55:05.059593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:56:36.228231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0459a57-3221-4416-92ec-ea134d14ffca None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:36.228831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0459a57-3221-4416-92ec-ea134d14ffca None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:36.228831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0459a57-3221-4416-92ec-ea134d14ffca None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:36.230182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:56:36.235324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df698-a748-45ad-8c36-aa1014c66422 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:36.235818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df698-a748-45ad-8c36-aa1014c66422 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:36.235928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df698-a748-45ad-8c36-aa1014c66422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:36.254489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2f8df698-a748-45ad-8c36-aa1014c66422 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:36.255771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2f8df698-a748-45ad-8c36-aa1014c66422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:36.317310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:36.472478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0459a57-3221-4416-92ec-ea134d14ffca None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:36.474174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f0459a57-3221-4416-92ec-ea134d14ffca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:36.548711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0459a57-3221-4416-92ec-ea134d14ffca None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:36.554162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604544b-1063-4370-8b98-4567393c6821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:36.554804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604544b-1063-4370-8b98-4567393c6821 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:36.555088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604544b-1063-4370-8b98-4567393c6821 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:36.555364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604544b-1063-4370-8b98-4567393c6821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:36.563378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604544b-1063-4370-8b98-4567393c6821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:36.564984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604544b-1063-4370-8b98-4567393c6821 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:36.574746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 754/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:37.402042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55fcb-0f60-41a1-a94a-c706477bf189 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:37.402471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55fcb-0f60-41a1-a94a-c706477bf189 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:37.402590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c55fcb-0f60-41a1-a94a-c706477bf189 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:37.404030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:56:37.408892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd0dc-e5ba-44c8-8fdd-b5f0665f474f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:37.409314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd0dc-e5ba-44c8-8fdd-b5f0665f474f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:37.409451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cd0dc-e5ba-44c8-8fdd-b5f0665f474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:37.428429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3e3cd0dc-e5ba-44c8-8fdd-b5f0665f474f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:37.429621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3e3cd0dc-e5ba-44c8-8fdd-b5f0665f474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:37.437378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:37.593088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55fcb-0f60-41a1-a94a-c706477bf189 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:37.607686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c55fcb-0f60-41a1-a94a-c706477bf189 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:37.613305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e96995-bf52-4643-bc68-94a2dab50717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:37.613944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96995-bf52-4643-bc68-94a2dab50717 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:37.614224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96995-bf52-4643-bc68-94a2dab50717 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:37.614497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96995-bf52-4643-bc68-94a2dab50717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:37.623243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e96995-bf52-4643-bc68-94a2dab50717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:37.624864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e96995-bf52-4643-bc68-94a2dab50717 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:37.634795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 761/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:37.796927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25bf6-3838-48bb-af43-facc0a6f0cd5 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:37.797211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25bf6-3838-48bb-af43-facc0a6f0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:37.797488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb25bf6-3838-48bb-af43-facc0a6f0cd5 None None] PATH_INFO: `/v3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:37.798835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 756/1517] 10.222.0.52 () {54 vars in 925 bytes} [Tue Jun 21 09:56:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:56:37.815045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a1ae-dfc4-4326-823c-e4a26fea18e5 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:37.815327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a1ae-dfc4-4326-823c-e4a26fea18e5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:37.815598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565a1ae-dfc4-4326-823c-e4a26fea18e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:37.834200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6565a1ae-dfc4-4326-823c-e4a26fea18e5 None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:37.835428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6565a1ae-dfc4-4326-823c-e4a26fea18e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:37.897936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 762/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jun 21 09:56:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:46.734036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059493-70dc-4537-9bbc-6a639814c5dc None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:46.734540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059493-70dc-4537-9bbc-6a639814c5dc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:46.734540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58059493-70dc-4537-9bbc-6a639814c5dc None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:46.735930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 757/1519] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jun 21 09:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:56:46.741351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff957d-782a-47bd-a05b-06658b674ef3 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:46.741743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff957d-782a-47bd-a05b-06658b674ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:46.741905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff957d-782a-47bd-a05b-06658b674ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:46.759915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-29ff957d-782a-47bd-a05b-06658b674ef3 None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:46.761115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-29ff957d-782a-47bd-a05b-06658b674ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:46.769398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 763/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jun 21 09:56:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:46.776675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58059493-70dc-4537-9bbc-6a639814c5dc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:46.789932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58059493-70dc-4537-9bbc-6a639814c5dc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:46.795361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d49a7-6d16-4238-9d4c-0889f643d5b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:46.796018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d49a7-6d16-4238-9d4c-0889f643d5b0 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:46.796312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d49a7-6d16-4238-9d4c-0889f643d5b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:46.796595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d49a7-6d16-4238-9d4c-0889f643d5b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:46.805522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d49a7-6d16-4238-9d4c-0889f643d5b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:46.807095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d49a7-6d16-4238-9d4c-0889f643d5b0 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:46.816728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 758/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:48.843189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b68974-e789-47ad-85c2-61734ecd0500 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:48.843787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b68974-e789-47ad-85c2-61734ecd0500 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:48.843787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b68974-e789-47ad-85c2-61734ecd0500 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:48.845139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:56:48.849940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d54102-3e70-4d8b-ade6-5013ea575d80 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:48.850385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d54102-3e70-4d8b-ade6-5013ea575d80 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:48.850511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d54102-3e70-4d8b-ade6-5013ea575d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:48.869023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-22d54102-3e70-4d8b-ade6-5013ea575d80 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:48.870216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-22d54102-3e70-4d8b-ade6-5013ea575d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:48.878406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:49.030522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b68974-e789-47ad-85c2-61734ecd0500 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:49.045141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b68974-e789-47ad-85c2-61734ecd0500 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:49.050374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533f69d-e45c-4ff4-9b60-7c7657214288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:49.050997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533f69d-e45c-4ff4-9b60-7c7657214288 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:49.051279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533f69d-e45c-4ff4-9b60-7c7657214288 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:49.051552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533f69d-e45c-4ff4-9b60-7c7657214288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:49.059955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533f69d-e45c-4ff4-9b60-7c7657214288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:49.061547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533f69d-e45c-4ff4-9b60-7c7657214288 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:49.071370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 765/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:49.880139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a107-bb74-43f2-a6de-82b5dfa022a4 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:49.880816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a107-bb74-43f2-a6de-82b5dfa022a4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:49.880816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7a107-bb74-43f2-a6de-82b5dfa022a4 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:49.882914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 09:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:56:49.888275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353258-ad6d-481c-a1fc-6d7465415ab5 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:49.889039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353258-ad6d-481c-a1fc-6d7465415ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:49.889216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f353258-ad6d-481c-a1fc-6d7465415ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:49.907308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-8f353258-ad6d-481c-a1fc-6d7465415ab5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:49.908541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8f353258-ad6d-481c-a1fc-6d7465415ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:49.916904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 09:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:50.069345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a107-bb74-43f2-a6de-82b5dfa022a4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:50.083717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7a107-bb74-43f2-a6de-82b5dfa022a4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:50.089131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921a3b2-aea9-4105-a706-84a2a4acb2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:50.089766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a3b2-aea9-4105-a706-84a2a4acb2c9 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:50.090053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a3b2-aea9-4105-a706-84a2a4acb2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:50.090335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921a3b2-aea9-4105-a706-84a2a4acb2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:50.099223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921a3b2-aea9-4105-a706-84a2a4acb2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:50.100877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921a3b2-aea9-4105-a706-84a2a4acb2c9 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:50.110559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 761/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:54.027608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60579d-1a76-4f7d-bf3f-b88a91a72be8 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:54.028299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60579d-1a76-4f7d-bf3f-b88a91a72be8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:54.028299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60579d-1a76-4f7d-bf3f-b88a91a72be8 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:54.029554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:56:54.034914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1cad-05e0-4752-b773-a44c3a3a92fe None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:54.035311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1cad-05e0-4752-b773-a44c3a3a92fe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:54.035474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1cad-05e0-4752-b773-a44c3a3a92fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:54.052960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-33ac1cad-05e0-4752-b773-a44c3a3a92fe None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:54.054660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-33ac1cad-05e0-4752-b773-a44c3a3a92fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:54.062373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:54.098658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60579d-1a76-4f7d-bf3f-b88a91a72be8 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:54.100349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-cf60579d-1a76-4f7d-bf3f-b88a91a72be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:54.156501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60579d-1a76-4f7d-bf3f-b88a91a72be8 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:54.159938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477bcd5-9cba-4fc7-bf19-e697c7dad616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:54.160596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477bcd5-9cba-4fc7-bf19-e697c7dad616 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:54.160877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477bcd5-9cba-4fc7-bf19-e697c7dad616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:54.161152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477bcd5-9cba-4fc7-bf19-e697c7dad616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:54.169820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477bcd5-9cba-4fc7-bf19-e697c7dad616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:54.171234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477bcd5-9cba-4fc7-bf19-e697c7dad616 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:54.176061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:56:54.181954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 768/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:56.207630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57404b70-8c81-47a0-91c6-a0c121b85791 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:56.208177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57404b70-8c81-47a0-91c6-a0c121b85791 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:56.208295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57404b70-8c81-47a0-91c6-a0c121b85791 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:56.209655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:56:56.214699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730df66-1ccc-4e54-ac11-301f3002456b None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:56.215101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730df66-1ccc-4e54-ac11-301f3002456b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:56.215272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730df66-1ccc-4e54-ac11-301f3002456b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:56.233896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0730df66-1ccc-4e54-ac11-301f3002456b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:56.235086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0730df66-1ccc-4e54-ac11-301f3002456b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:56.243456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:56:56.278387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57404b70-8c81-47a0-91c6-a0c121b85791 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:56:56.289705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57404b70-8c81-47a0-91c6-a0c121b85791 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:56:56.293207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032c5cc-01c3-4b47-9548-358914b572ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:56:56.293832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c5cc-01c3-4b47-9548-358914b572ec service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:56.294117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c5cc-01c3-4b47-9548-358914b572ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:56.294410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032c5cc-01c3-4b47-9548-358914b572ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:56.303130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032c5cc-01c3-4b47-9548-358914b572ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:56:56.305220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032c5cc-01c3-4b47-9548-358914b572ec service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:56:56.314450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 764/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:56:59.852786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b418f8-38e1-4682-94e8-8b1453709074 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:59.853411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b418f8-38e1-4682-94e8-8b1453709074 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:59.853629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b418f8-38e1-4682-94e8-8b1453709074 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:59.855349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:56:59.861001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda60ec-3650-4daa-b53b-201460bfc2c9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:56:59.861478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda60ec-3650-4daa-b53b-201460bfc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:56:59.861587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda60ec-3650-4daa-b53b-201460bfc2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:56:59.879309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9eda60ec-3650-4daa-b53b-201460bfc2c9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:56:59.880547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9eda60ec-3650-4daa-b53b-201460bfc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:56:59.890240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:57:00.190112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b418f8-38e1-4682-94e8-8b1453709074 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:57:00.191795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d0b418f8-38e1-4682-94e8-8b1453709074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:57:00.263321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b418f8-38e1-4682-94e8-8b1453709074 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:57:00.267519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb29c6-987d-4b88-b3c1-e94374f87fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:57:00.268226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb29c6-987d-4b88-b3c1-e94374f87fcf service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:57:00.268541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb29c6-987d-4b88-b3c1-e94374f87fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:57:00.268932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb29c6-987d-4b88-b3c1-e94374f87fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:57:00.278163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb29c6-987d-4b88-b3c1-e94374f87fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:57:00.279631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb29c6-987d-4b88-b3c1-e94374f87fcf service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:57:00.288955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 771/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:57:02.342684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839545cd-172e-47c6-b40a-f430ab5a1bea None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:57:02.343300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839545cd-172e-47c6-b40a-f430ab5a1bea None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:57:02.343300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839545cd-172e-47c6-b40a-f430ab5a1bea None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:57:02.344682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 09:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:57:02.349746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c84282-0c22-4574-aa43-f5d7ae2c16bb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:57:02.350139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c84282-0c22-4574-aa43-f5d7ae2c16bb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:57:02.350247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c84282-0c22-4574-aa43-f5d7ae2c16bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:57:02.368783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e9c84282-0c22-4574-aa43-f5d7ae2c16bb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:57:02.369977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e9c84282-0c22-4574-aa43-f5d7ae2c16bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:57:02.377693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 09:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:57:02.678080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839545cd-172e-47c6-b40a-f430ab5a1bea None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:57:02.680491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-839545cd-172e-47c6-b40a-f430ab5a1bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:57:02.694861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839545cd-172e-47c6-b40a-f430ab5a1bea None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:57:02.699527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccaf91-ade9-459a-8f62-e975c7635fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:57:02.700209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccaf91-ade9-459a-8f62-e975c7635fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:57:02.700498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccaf91-ade9-459a-8f62-e975c7635fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:57:02.700777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccaf91-ade9-459a-8f62-e975c7635fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:57:02.709815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccaf91-ade9-459a-8f62-e975c7635fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:57:02.711310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccaf91-ade9-459a-8f62-e975c7635fb9 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:57:02.720649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 767/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:57:12.363150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=32 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:57:12.716619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=70 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:30.826292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71195db6-1291-405e-bb53-0b55f85ee8a4 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:30.828139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71195db6-1291-405e-bb53-0b55f85ee8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:30.828896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71195db6-1291-405e-bb53-0b55f85ee8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:30.857126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-71195db6-1291-405e-bb53-0b55f85ee8a4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:30.858726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-71195db6-1291-405e-bb53-0b55f85ee8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:30.878249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 773/1540] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:30.889045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:30.889962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:30.890405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:30.905779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:30.906065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:30.906345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:30.915541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:30.917149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:30.926326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 768/1541] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:30.935473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:30.945839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956add16-b1af-45dc-8ed7-5b8660b00ddd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:30.950850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:30.951398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:30.955443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:30.956412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:30.957051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:30.957549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:30.958725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:30.959252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:30.960621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:58:30.960621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:58:30.960621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:58:30.962058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90301faa-4c6b-47b0-b101-3ba568866ca9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:30.973726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 774/1542] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 21 09:58:30.981975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 769/1543] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:58:30.990094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:30.995997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:30.995997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:30.995997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.018350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c86df-7ca4-432f-be87-e1b37f67a114 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.019424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.020902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.031407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.031641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 770/1544] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.032456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.032894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.033332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.034165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.035316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:58:31.035316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:58:31.035316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:58:31.036800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.042599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.053085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5f393-e7cc-4dfe-9e05-f0dfda28ae4f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.062199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.063039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.063430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.063809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.064686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.065091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.066805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7e9c2-7e36-475f-a595-6f3a8501a0a7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.091642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 771/1545] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:58:31.094071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.094988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.101079 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.110451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 775/1546] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:30 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:31.111625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.139026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.145585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.259178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 772/1547] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.261192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.271656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a7c4f-0b46-4eea-a2cb-c1ebf6d082ca None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.287624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.288341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.288624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.288900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.289600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.290659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:58:31.290659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:58:31.290659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:58:31.294837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef630725-3ac5-4d8a-96cf-ac313fdce238 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.295663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b2dab-a288-4ee1-81c3-b90fd88140b8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.311360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5408bd-8220-4a63-a577-f4b4f1549ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.312061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5408bd-8220-4a63-a577-f4b4f1549ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.312345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5408bd-8220-4a63-a577-f4b4f1549ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.312620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5408bd-8220-4a63-a577-f4b4f1549ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.313312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5408bd-8220-4a63-a577-f4b4f1549ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.316375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5408bd-8220-4a63-a577-f4b4f1549ea4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.342224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 773/1548] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/users => generated 286 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:31.343852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1be16-b229-44bc-ab42-4c8f050626a7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.344335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1be16-b229-44bc-ab42-4c8f050626a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.344783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1be16-b229-44bc-ab42-4c8f050626a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.359916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 776/1549] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:31.363197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.366684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.367155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.382962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6bc1be16-b229-44bc-ab42-4c8f050626a7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.388185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6bc1be16-b229-44bc-ab42-4c8f050626a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.403708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.405129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.473727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 774/1550] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.475503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.475853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.476290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.485883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 777/1551] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.486795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.497339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4acf3-0673-4b4e-b1bf-d3f4ab9d6a1d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.498917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.500155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.504892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1fb2cf-2595-4305-9f97-a4a29f8d41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.505563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fb2cf-2595-4305-9f97-a4a29f8d41c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.505872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fb2cf-2595-4305-9f97-a4a29f8d41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.506209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1fb2cf-2595-4305-9f97-a4a29f8d41c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.506908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fb2cf-2595-4305-9f97-a4a29f8d41c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.508388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 775/1552] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.508602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1fb2cf-2595-4305-9f97-a4a29f8d41c7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.517993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.522036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 778/1553] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:31.522036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c157-f6a4-4297-b1ec-78a1dac7b00c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.522036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c157-f6a4-4297-b1ec-78a1dac7b00c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.522036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c157-f6a4-4297-b1ec-78a1dac7b00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.528151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9a5c-eb91-42e9-b883-3a17b39f203c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.532532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638316c-c870-4336-a487-21f327ed71ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.533196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638316c-c870-4336-a487-21f327ed71ca admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.533476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638316c-c870-4336-a487-21f327ed71ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.533754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638316c-c870-4336-a487-21f327ed71ca admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.534442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638316c-c870-4336-a487-21f327ed71ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.536560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638316c-c870-4336-a487-21f327ed71ca admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.541467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b8d3c157-f6a4-4297-b1ec-78a1dac7b00c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.542657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b8d3c157-f6a4-4297-b1ec-78a1dac7b00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.551719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 779/1554] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.553164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.553680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.554031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.565647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 776/1555] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/users => generated 302 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:31.565647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f8f6b-9c74-4635-b9df-9cc5e47e7bf2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.565647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f8f6b-9c74-4635-b9df-9cc5e47e7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.565647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f8f6b-9c74-4635-b9df-9cc5e47e7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.572951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.574160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.582057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 780/1556] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.582726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b21f8f6b-9c74-4635-b9df-9cc5e47e7bf2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.584049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b21f8f6b-9c74-4635-b9df-9cc5e47e7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.584974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.592559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 777/1557] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.593796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.594082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.594381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.595084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4649a29-1dcc-47a9-8927-20f9421be564 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.599999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.600646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.601019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.601193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.601912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.602215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.604409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6919f5-c3aa-4e67-acc1-0333411ae71f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.613469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.614663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.616077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 781/1558] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:31.617277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36049ed-3266-4694-ada6-3598cc4161b9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.617563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36049ed-3266-4694-ada6-3598cc4161b9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.617837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36049ed-3266-4694-ada6-3598cc4161b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.626585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 778/1559] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.627447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.637139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f16ee8-a418-4d8f-8628-a17666a6881a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.641727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.642382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.642666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.642947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.643671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.644758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a36049ed-3266-4694-ada6-3598cc4161b9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.645302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.645941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a36049ed-3266-4694-ada6-3598cc4161b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.646639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:31.654681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 782/1560] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.655943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfe7f-7944-4351-a94f-cfdd9064ce35 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.656262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfe7f-7944-4351-a94f-cfdd9064ce35 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.656537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dfe7f-7944-4351-a94f-cfdd9064ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.659860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 779/1561] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:31.660770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.669848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:31.670493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3f76d-c7ad-4e25-93ec-0912e663afb7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.675498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.676175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.676457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.676733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.676840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5c8dfe7f-7944-4351-a94f-cfdd9064ce35 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.677455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.678393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5c8dfe7f-7944-4351-a94f-cfdd9064ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.679038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.687352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 783/1562] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.688595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.688883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.689160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.689697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 780/1563] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:31.690473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.700320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd943f-6b29-47de-afd2-01899489341a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.704927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.705560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.705843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.706124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.706439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.706829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.707135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.707661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.708734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095e111-e326-4e1a-96ec-51cb3c986bf6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.715410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 784/1564] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.716335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.728814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 781/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:31.728814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.728814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.728814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.729258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153981e-9d3e-44af-a14f-8b2250eff500 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.730871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.731502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.731784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.732089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.732769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.734905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.742218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:31.743411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:31.753778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 782/1566] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:31.754714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.764192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35081cbf-d517-43eb-a1e6-6761ce46fda6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.768994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 785/1567] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:31.768994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.829801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8c0b2-1aef-46a3-ab20-4b1599949515 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.834533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.835414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.835640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.835806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.835958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] PATH_INFO: `/v3/projects/50ae1201bbc54bef84cfacc2b9d4559e/users/38bfb31c41614cf8ae90cf524179292f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.836643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.837070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.838007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.839118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.839583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.842237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.852861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ae1201bbc54bef84cfacc2b9d4559e, user_id=38bfb31c41614cf8ae90cf524179292f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.854445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:58:31.854445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:58:31.854445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:58:31.862994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 783/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:31.863160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.863280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.866914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0783c-a336-4982-b00c-16bbf044594e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.872398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.873150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.873489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.873827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.874573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.876445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 786/1569] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:31 2022] PUT /identity/v3/projects/50ae1201bbc54bef84cfacc2b9d4559e/users/38bfb31c41614cf8ae90cf524179292f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:31.876590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.877154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.890650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 784/1570] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:31.890650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.898398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10227755-ee8d-47e2-add1-5b81e09e4e76 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.943422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579778cf-119e-4f23-b527-0f2cf033e938 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.948135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.948790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.949148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.949427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.950151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.950463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.952096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.954548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.955199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.955482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.955755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.956504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.956812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.958390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.963838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 787/1571] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:31.964803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.974232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85fb3-bc43-4cfe-b6e4-3ac4bd05a4a5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.976748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 785/1572] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:31.977559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:31.985135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.985784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.986069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.986348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.987035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:31.988986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:31.992459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5335a-b763-4fb9-a512-c7cbae5ea283 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:31.997093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:31.997727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:31.998141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:31.998423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:31.999161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:31.999472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.001082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.013731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 786/1573] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:32.016106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 788/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:31 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.016850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.017976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.028933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79983da-54fb-4ced-9b84-6f69edae770c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.051548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:32.055240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:32.084260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5c5d5-c91b-4c20-9174-28c37b2743d7 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.086199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675bd02-e169-44fb-a149-25967e22ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.086872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675bd02-e169-44fb-a149-25967e22ff8b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.087159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675bd02-e169-44fb-a149-25967e22ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.087442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675bd02-e169-44fb-a149-25967e22ff8b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.088696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675bd02-e169-44fb-a149-25967e22ff8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.090652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675bd02-e169-44fb-a149-25967e22ff8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.092148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.092816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.093091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.093368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.094055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.095960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.115377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 787/1575] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.116846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.117278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.117466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.125686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 789/1576] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.126424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.153375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] MFA Rules not processed for user `38bfb31c41614cf8ae90cf524179292f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:32.154602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:32.200136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6fc64-d619-4851-a3eb-b2fae9acef07 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.206394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.207717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.208191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.208619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] PATH_INFO: `/v3/projects/bff1d87d05dc4af6a2abf8d10c40cbc1/users/e77b6a34160e43f7b94c44eda5c647b6/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.222671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 788/1577] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:32.223484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.225020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bff1d87d05dc4af6a2abf8d10c40cbc1, user_id=e77b6a34160e43f7b94c44eda5c647b6, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.228733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.235264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734afcb-1212-4beb-b8f3-800cace9a31a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.240491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.241145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.241435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.241710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.242402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.242759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 790/1578] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:32 2022] PUT /identity/v3/projects/bff1d87d05dc4af6a2abf8d10c40cbc1/users/e77b6a34160e43f7b94c44eda5c647b6/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:32.243528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.245037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.275256 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 789/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/projects => generated 403 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.276086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.305946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193be1a-5468-412c-b00e-f295a2c4ac8e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.337796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0588-011b-448e-b996-dcddb560b7bd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.342345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.343001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.343294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.343557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.344259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.345815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:32.346158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.365813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.366409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.366697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.366973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.367434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 790/1580] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.367663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.368250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.370230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.378141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b0a20-bca2-43dd-83d0-0524b4553c8d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.382880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.383628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.384620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.385021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.385754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.387838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.399228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 791/1581] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.399228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.404287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:32.420630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 791/1582] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.421529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.463623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f201a8-dffd-4659-8556-8172ce7344a3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.482976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ef915-8f4a-47f6-8eab-9ec908bde88a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.487758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.488449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.488735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.489006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.489721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.491635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.513418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 792/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.513418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.524342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cd3fa-f352-4bbd-9bd8-e81f3bd6fee3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.528960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.529601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.529883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.530166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.530847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.531841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62502-d51f-4c98-9be8-9deea25e38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.532533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62502-d51f-4c98-9be8-9deea25e38a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.532887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.532994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62502-d51f-4c98-9be8-9deea25e38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.535434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62502-d51f-4c98-9be8-9deea25e38a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.538347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f62502-d51f-4c98-9be8-9deea25e38a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.542629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f62502-d51f-4c98-9be8-9deea25e38a2 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.553060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 792/1584] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.554304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.554592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.554870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.563140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 793/1585] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.563140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.581461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] MFA Rules not processed for user `e77b6a34160e43f7b94c44eda5c647b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:32.582670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:32.625099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30069-d034-49e0-95b7-01769067e5ca admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.630060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.630727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.631009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.631291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.631993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.633923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.645087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:32.649493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 793/1586] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:32.650848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.658062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 794/1587] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.658966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.666912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96198e45-575d-4525-8986-c68e5b1ec8fa None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.669254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a76ca-b1ab-4ece-bad1-2337928e7b19 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.671585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.672456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.672738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.673011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.673730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.674080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.674751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.675037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.675390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.675498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.676107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.678009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.685548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 794/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.686312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.696010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067965f6-1cd2-450d-9216-182468cc8f92 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.701413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 795/1589] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 294 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.701413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.703202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.703847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.704154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.704461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.705106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.706992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.708431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1063cf-3fee-4cc3-942d-f17bc0ba854d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.713611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.714240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.714523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.714800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.715518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.717225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.727593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 795/1590] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.728813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.728995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 796/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.729762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.739414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708bad9-132a-4ec8-b02c-2b2ace626b0f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.743547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c077f6f-0cd4-4605-a0d3-22dabb47a913 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.743886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.744615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.744833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.745105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.745774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.747639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.748145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.748783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.749062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.749337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.750052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.752515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.764949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 796/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.765651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.768489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 797/1593] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.769411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.776174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:INSERT=14,keystone:SELECT=86 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:32.778451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b603d-6ca8-4813-98f1-f27dc36b110d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.780407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe18d02-73bb-4b8d-a4cd-dae03ea0b644 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.783412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.784109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.784536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.784825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.785537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.786206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.786970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.787343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.787442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.787751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.788647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.790316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.801205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 798/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.802231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.812681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a76d2-ecdf-43dd-88a5-2176d95e299f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.817500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.820912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 797/1595] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:32.821076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.821076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.821268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.821362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.821362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.821362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.832041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 799/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.832902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.842825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925541e-7628-4e7a-a59e-426574523ba5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.889157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3682e-11d9-4b9e-bd7b-ce11ab76fd31 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.893886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.894542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.894823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.895096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.895819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.897568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.900741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.901436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.901719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.901998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.902726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.904408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.908105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 798/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.908716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.918425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 800/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.918425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.921067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bf170-3a5c-408b-98de-2e1f21caa5c4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.925742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.926031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b31c6-8c22-4824-a088-6a8de6d4b660 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.926386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.926712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.926990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.927694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.929306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.930744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.931655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.931943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.932260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] PATH_INFO: `/v3/projects/04010e51729946f19aae76a3af4a5976/users/8c1def94f6364acd9da7f7e0654bc8fc/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.939630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 799/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.940462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.946974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04010e51729946f19aae76a3af4a5976, user_id=8c1def94f6364acd9da7f7e0654bc8fc, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.949658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.949805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40542795-8e20-4d3f-85df-dcc25d97edaa admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:32.954567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:32.955202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:32.955506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:32.955772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:32.956506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:32.958122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:32.963282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 801/1600] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:32 2022] PUT /identity/v3/projects/04010e51729946f19aae76a3af4a5976/users/8c1def94f6364acd9da7f7e0654bc8fc/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:32.963885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.972894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 800/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:32.972894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:32.981067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc470402-4a2b-4c2a-885f-2cb8128cde34 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.029686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a501ab-c01a-4a15-801e-5e4bf3565383 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.034648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.035420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.035796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.036174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.036896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.037009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.037654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.038050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.038339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.038478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.039062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.041065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.048509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 802/1602] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:33.049332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.059533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6bf81-f9ee-4047-af76-161f57933e05 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.065685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 801/1603] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:32 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:33.065685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.066562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.067443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.067752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.068051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] PATH_INFO: `/v3/projects/7a80df511c544924a5708de2513bbc42/users/7e98533664dd4bf6b90e471fc42ba41f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.070211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:33.076366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533aaf-495f-4356-befe-ffa2cea886ac admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.081942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.082792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.083073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.083347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.083779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a80df511c544924a5708de2513bbc42, user_id=7e98533664dd4bf6b90e471fc42ba41f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.084105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.085766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.086518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.097512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 802/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:33.098409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.102724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 803/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/7a80df511c544924a5708de2513bbc42/users/7e98533664dd4bf6b90e471fc42ba41f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.105382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.108509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4d033-3f04-40cb-8279-588e61014357 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.135312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:33.166322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.167146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.167434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.167711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] PATH_INFO: `/v3/projects/1a5852acb729432e89c68955c8ed5e8b/users/d3d76c556b5f41f19c1a2a466a031cdf/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.168815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76a0c9-d14f-4fb7-91cc-31142b8a7409 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.174166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd773488-faae-4949-b372-dd02da1bafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.174824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773488-faae-4949-b372-dd02da1bafbc admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.175103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773488-faae-4949-b372-dd02da1bafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.175406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd773488-faae-4949-b372-dd02da1bafbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.176192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd773488-faae-4949-b372-dd02da1bafbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.177802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd773488-faae-4949-b372-dd02da1bafbc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.182118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5852acb729432e89c68955c8ed5e8b, user_id=d3d76c556b5f41f19c1a2a466a031cdf, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.184806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.187504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 804/1606] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:33.188804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.189028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.189310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.200092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 803/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/1a5852acb729432e89c68955c8ed5e8b/users/d3d76c556b5f41f19c1a2a466a031cdf/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.201064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.209174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:33.210362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.261010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1eed4-6491-43ab-8e6b-15f5384a444b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.265674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.266553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.266838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.267113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] PATH_INFO: `/v3/projects/6e711771e86c47988068efb0610a4b9d/users/c49c127a90e24ab1a4f506421eb44190/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.267614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 805/1608] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:33.268476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.277756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862d7c-9927-4f4a-aaa8-04164fb6612b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.283129 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.283655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e711771e86c47988068efb0610a4b9d, user_id=c49c127a90e24ab1a4f506421eb44190, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.284041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.284325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.284601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] PATH_INFO: `/v3/projects/e97807e604d54109a383181e4c5c3400/users/19b1e3fad13b442ab98fbb7b684dcfa0/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.286344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.300063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 804/1609] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/6e711771e86c47988068efb0610a4b9d/users/c49c127a90e24ab1a4f506421eb44190/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.300304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e97807e604d54109a383181e4c5c3400, user_id=19b1e3fad13b442ab98fbb7b684dcfa0, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.302825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.303951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.315740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 806/1610] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/e97807e604d54109a383181e4c5c3400/users/19b1e3fad13b442ab98fbb7b684dcfa0/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.316631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.365034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:33.369455 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b67759-0bf7-412e-be85-20b0a109ff60 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.375528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65163323-0550-48fc-9cc9-9038f40ce9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.376226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163323-0550-48fc-9cc9-9038f40ce9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.376513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163323-0550-48fc-9cc9-9038f40ce9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.376796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65163323-0550-48fc-9cc9-9038f40ce9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.377523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65163323-0550-48fc-9cc9-9038f40ce9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.377991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac02d15-0c65-4292-9f7e-a36514129844 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.379135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65163323-0550-48fc-9cc9-9038f40ce9e4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.382751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175760a2-4faa-47df-bf81-7d632020365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.383627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175760a2-4faa-47df-bf81-7d632020365e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.383905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175760a2-4faa-47df-bf81-7d632020365e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.384213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175760a2-4faa-47df-bf81-7d632020365e admin admin] PATH_INFO: `/v3/projects/318fe395ab574501973a3a20d0c77bfc/users/bf85b80a4bb747da9bd07454536380c0/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.389620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 805/1611] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:33.391049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.391344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.391625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.402649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175760a2-4faa-47df-bf81-7d632020365e admin admin] RBAC: Authorizing `identity:create_grant(project_id=318fe395ab574501973a3a20d0c77bfc, user_id=bf85b80a4bb747da9bd07454536380c0, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.405352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175760a2-4faa-47df-bf81-7d632020365e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.408655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:33.409881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.417798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 806/1612] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:33.418484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.420522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 807/1613] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/318fe395ab574501973a3a20d0c77bfc/users/bf85b80a4bb747da9bd07454536380c0/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.422461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.422927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.423289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.432024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdea16-5064-45c3-a6b2-ee1212cd5ae8 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.441147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:33.442545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.459470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:33.487246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.488171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.488460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.488732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] PATH_INFO: `/v3/projects/c8dc9e553cda4326a9dd10c3e0a35546/users/1fde108762d645bc9c5c5791dfe646a0/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.502781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 808/1614] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:33.503483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dc9e553cda4326a9dd10c3e0a35546, user_id=1fde108762d645bc9c5c5791dfe646a0, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.503612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.504904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.509450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.525194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 807/1615] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/c8dc9e553cda4326a9dd10c3e0a35546/users/1fde108762d645bc9c5c5791dfe646a0/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.526223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.562144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef00fd8-8d5a-454b-94de-d089000048eb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.586208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c61fb-4518-4af7-a136-3b898860806c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.590714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2cc8-d9f8-4fed-a131-b4ad07156439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.591362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2cc8-d9f8-4fed-a131-b4ad07156439 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.591643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2cc8-d9f8-4fed-a131-b4ad07156439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.591919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2cc8-d9f8-4fed-a131-b4ad07156439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.592664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2cc8-d9f8-4fed-a131-b4ad07156439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.594330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2cc8-d9f8-4fed-a131-b4ad07156439 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.604439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 808/1616] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:33.605635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.605925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.606200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.612712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02510e-2519-400a-bf7a-be043fc168e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.613355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02510e-2519-400a-bf7a-be043fc168e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.613637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02510e-2519-400a-bf7a-be043fc168e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.613923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02510e-2519-400a-bf7a-be043fc168e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.623409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02510e-2519-400a-bf7a-be043fc168e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.624861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec02510e-2519-400a-bf7a-be043fc168e8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.625252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:33.626459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.634276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 809/1617] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:33.634484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 809/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:33.635857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.636187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.636479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.636755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.653046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce95745-5764-4fde-83eb-7142642e6133 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.654433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:33.655681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.659159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.660309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.660752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.661211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] PATH_INFO: `/v3/projects/e7ca45b5d2ed44ae8cbf8896f31330a4/users/bc1b11b11cfc4435a6b434c73d8292c6/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.672249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 810/1619] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:33.672249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.678902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca45b5d2ed44ae8cbf8896f31330a4, user_id=bc1b11b11cfc4435a6b434c73d8292c6, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.680866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11952d3-8ce6-4c58-8484-dcd5ec53ee11 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.683149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.685073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b34de-0c40-4a2d-badc-2c0f7f63b966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.685847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b34de-0c40-4a2d-badc-2c0f7f63b966 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.686246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b34de-0c40-4a2d-badc-2c0f7f63b966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.686533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b34de-0c40-4a2d-badc-2c0f7f63b966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.698696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b34de-0c40-4a2d-badc-2c0f7f63b966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.698920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 810/1620] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/e7ca45b5d2ed44ae8cbf8896f31330a4/users/bc1b11b11cfc4435a6b434c73d8292c6/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.700309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.700449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b34de-0c40-4a2d-badc-2c0f7f63b966 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.712096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 811/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:33.713499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.713789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.714068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.737132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:33.738781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:33.753456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:33.771733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07d90b-e6dd-494b-9a92-9d1d131b39bd admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.776473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.777362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.777996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.778420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.830427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 812/1622] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:33.833858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.837049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:33.844393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b1f35-7e4b-45d4-b4ad-dc57a3c5bb49 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.848790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.850272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.850723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.851926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.852334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.852905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] PATH_INFO: `/v3/projects/6e711771e86c47988068efb0610a4b9d/users/c49c127a90e24ab1a4f506421eb44190/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:33.857311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e711771e86c47988068efb0610a4b9d, user_id=c49c127a90e24ab1a4f506421eb44190, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:33.860730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:33.863198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 811/1623] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:33.864229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.873652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d882-f5d3-4c8f-8a34-840138975293 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:33.881491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 813/1624] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:33 2022] PUT /identity/v3/projects/6e711771e86c47988068efb0610a4b9d/users/c49c127a90e24ab1a4f506421eb44190/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:33.883244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:33.966232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:33.967457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:33.967873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:33.968276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.004530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c315c-8d2c-431f-bf91-bf11cf30e677 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.009615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4190c-be53-4bd5-8af2-493bb0c0fa93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.010569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4190c-be53-4bd5-8af2-493bb0c0fa93 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.010992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4190c-be53-4bd5-8af2-493bb0c0fa93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.011319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4190c-be53-4bd5-8af2-493bb0c0fa93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.051113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.054159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.069643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 812/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:34.070560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:34.083068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77fedf-42bd-448c-895b-c05d53b30247 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.099850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.100333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.100615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.100889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.101796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.103879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.116944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 813/1626] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:34.117815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:34.131893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a7c0a-8a00-418b-bf83-07a89fe3c137 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.137095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.138036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.138327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.138607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.138726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4190c-be53-4bd5-8af2-493bb0c0fa93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.140667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4190c-be53-4bd5-8af2-493bb0c0fa93 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.150282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.152050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.160810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 814/1627] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:34.163548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.163726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 814/1628] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:34.164245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.164586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:34.164743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.178906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3faac-e4dd-42ec-b4b1-be5e78363bd2 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.185297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63d5b4-75af-43c2-a227-ef355bdbb6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.186714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d5b4-75af-43c2-a227-ef355bdbb6be admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.187188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d5b4-75af-43c2-a227-ef355bdbb6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.187648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d5b4-75af-43c2-a227-ef355bdbb6be admin admin] PATH_INFO: `/v3/projects/e7ca45b5d2ed44ae8cbf8896f31330a4/users/bc1b11b11cfc4435a6b434c73d8292c6/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.189920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63d5b4-75af-43c2-a227-ef355bdbb6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca45b5d2ed44ae8cbf8896f31330a4, user_id=bc1b11b11cfc4435a6b434c73d8292c6, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.193918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63d5b4-75af-43c2-a227-ef355bdbb6be admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.202050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:34.206846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] MFA Rules not processed for user `c49c127a90e24ab1a4f506421eb44190`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:34.209177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:34.211319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 815/1629] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:34 2022] PUT /identity/v3/projects/e7ca45b5d2ed44ae8cbf8896f31330a4/users/bc1b11b11cfc4435a6b434c73d8292c6/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:34.229998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.230798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.231150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.266437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] MFA Rules not processed for user `bc1b11b11cfc4435a6b434c73d8292c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:34.268016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:34.312755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 815/1630] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:34.326861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:34.361421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 816/1631] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:34.362301 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:34.376896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:34.400103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f127ea-137c-4458-b625-d4bb5460b753 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.414104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.416979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.417472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.417813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.430182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.432337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.444380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 816/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:34.474887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0aa6ab-90ba-4a52-935d-66b4ac4d3968 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.484442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64947c39-d123-4758-bf07-9e26518edd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.485123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64947c39-d123-4758-bf07-9e26518edd00 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.492006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64947c39-d123-4758-bf07-9e26518edd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.492006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64947c39-d123-4758-bf07-9e26518edd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.526451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64947c39-d123-4758-bf07-9e26518edd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.529674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64947c39-d123-4758-bf07-9e26518edd00 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:34.556101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 817/1633] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:34.844102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:34.940597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b068dea-4c3e-4005-b482-c55743d2c1de service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:34.954335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:34.955661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:34.955952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:34.956263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] PATH_INFO: `/v3/users/e77b6a34160e43f7b94c44eda5c647b6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:34.957744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77b6a34160e43f7b94c44eda5c647b6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:34.960415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:35.035683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77b6a34160e43f7b94c44eda5c647b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.052851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77b6a34160e43f7b94c44eda5c647b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.065532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77b6a34160e43f7b94c44eda5c647b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.074538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77b6a34160e43f7b94c44eda5c647b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.075617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77b6a34160e43f7b94c44eda5c647b6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.087224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 817/1634] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:58:34 2022] DELETE /identity/v3/users/e77b6a34160e43f7b94c44eda5c647b6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:35.094832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453233a3-7228-4276-b576-64910e60ea9a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:35.094832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453233a3-7228-4276-b576-64910e60ea9a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:35.094832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453233a3-7228-4276-b576-64910e60ea9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:35.133366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-453233a3-7228-4276-b576-64910e60ea9a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:35.135950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-453233a3-7228-4276-b576-64910e60ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:35.170630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:35.172157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:35.254074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:35.273850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 818/1635] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:35.288645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dc1f8-c78c-48ac-987b-3491cbe4d09d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:35.294558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:35.296193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:35.296335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:35.296767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] PATH_INFO: `/v3/users/38bfb31c41614cf8ae90cf524179292f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:35.298008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38bfb31c41614cf8ae90cf524179292f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:35.299955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:35.370528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38bfb31c41614cf8ae90cf524179292f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.386735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453233a3-7228-4276-b576-64910e60ea9a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:35.388887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-453233a3-7228-4276-b576-64910e60ea9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:35.397725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38bfb31c41614cf8ae90cf524179292f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.419257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38bfb31c41614cf8ae90cf524179292f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.434889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38bfb31c41614cf8ae90cf524179292f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.437566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-77a1848a-0e8d-4a92-93f9-e77b7c67c193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38bfb31c41614cf8ae90cf524179292f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:35.460568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 818/1636] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:58:35 2022] DELETE /identity/v3/users/38bfb31c41614cf8ae90cf524179292f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:35.467073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:35.469416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:35.470838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:35.476317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:35.515146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:35.519805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:35.543550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453233a3-7228-4276-b576-64910e60ea9a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:35.640208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:35.641186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:35.641476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:35.641761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:35.644659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:35.655840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 819/1637] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:35.670196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:35.671340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:35.682840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:35.684669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd2c79-e063-4615-a063-59c86b430784 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:35.693275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4ab24-31c0-45ff-9ef1-bc577b9fcf36 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:35.702054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:35.703474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:35.704125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:35.705089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:35.708260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 819/1638] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:35.731220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:35.739496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:35.756983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 820/1639] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:37.239885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:37.239885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:37.240581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:37.307814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] MFA Rules not processed for user `19b1e3fad13b442ab98fbb7b684dcfa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:37.310722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:37.321417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:37.323612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:37.347397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75827b8-beab-40c2-9dc8-095c37b68212 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:37.358892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:37.360074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:37.360366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:37.361022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] PATH_INFO: `/v3/projects/bff1d87d05dc4af6a2abf8d10c40cbc1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:37.375118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bff1d87d05dc4af6a2abf8d10c40cbc1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:37.376254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: WARNING py.warnings [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:58:37.376254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: warnings.warn(msg) Jun 21 09:58:37.376254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: Jun 21 09:58:37.377444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:37.496216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:37.500006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bff1d87d05dc4af6a2abf8d10c40cbc1', 'request_id': 'req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.519379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 820/1640] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:37.526451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:37.533891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:37.563959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bff1d87d05dc4af6a2abf8d10c40cbc1', 'request_id': 'req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.570800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5b9b2-8a99-4558-806f-369624c4e99f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:37.576490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bff1d87d05dc4af6a2abf8d10c40cbc1', 'request_id': 'req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.598217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] The token cache is being invalidate because project bff1d87d05dc4af6a2abf8d10c40cbc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:58:37.598525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.599215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.604418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 821/1641] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:58:37 2022] DELETE /identity/v3/projects/bff1d87d05dc4af6a2abf8d10c40cbc1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:37.605886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:37.608512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:37.731996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:37.733308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:37.733308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:37.733479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:37.734522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:37.736766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:37.761358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad7cb-8a5c-49c6-9da5-54d5914aa83e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:37.766334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:37.775582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:37.776535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:37.776827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:37.777114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] PATH_INFO: `/v3/users/bc1b11b11cfc4435a6b434c73d8292c6` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:37.781028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1b11b11cfc4435a6b434c73d8292c6)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:37.781519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 821/1642] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:37 2022] POST /identity/v3/projects => generated 405 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:37.782568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:37.783184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:37.785348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:37.879923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1b11b11cfc4435a6b434c73d8292c6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.912186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1b11b11cfc4435a6b434c73d8292c6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.925166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1b11b11cfc4435a6b434c73d8292c6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.937396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff143-795e-48f6-9df0-c5d8d1614400 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:37.939166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1b11b11cfc4435a6b434c73d8292c6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.939950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1b11b11cfc4435a6b434c73d8292c6'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:37.952882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:37.953832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:37.954278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:37.954748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:37.956645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:37.959245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 822/1643] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:58:37 2022] DELETE /identity/v3/users/bc1b11b11cfc4435a6b434c73d8292c6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:37.962600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.010033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 822/1644] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:37 2022] POST /identity/v3/users => generated 309 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:38.011798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:38.013425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:38.132818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:38.143596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df15db-62f8-4bca-946d-688b78d554c1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:38.153758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:38.153944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:38.154419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:38.155047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:38.155399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:38.155651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:38.156689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:38.159018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.174567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df034644-d7a9-4e3e-b7de-384c40aad397 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:38.178539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 823/1645] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:38.180522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:38.189602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:38.190567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:38.190853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:38.191132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] PATH_INFO: `/v3/projects/50ae1201bbc54bef84cfacc2b9d4559e` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:38.195170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2abe578-0149-4800-aba4-a36e8220075d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:38.196877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ae1201bbc54bef84cfacc2b9d4559e)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:38.199318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.203108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:38.203992 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:38.204844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:38.205850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] PATH_INFO: `/v3/projects/6d3f4cfbee1146d78f5886f063eafe9e/users/9181b0e46e5d431cae7bfa04c0e41b15/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:38.235731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3f4cfbee1146d78f5886f063eafe9e, user_id=9181b0e46e5d431cae7bfa04c0e41b15, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:38.240689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.281687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 824/1646] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:38 2022] PUT /identity/v3/projects/6d3f4cfbee1146d78f5886f063eafe9e/users/9181b0e46e5d431cae7bfa04c0e41b15/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:38.284336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:38.292005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ae1201bbc54bef84cfacc2b9d4559e', 'request_id': 'req-f68e9990-fcaf-45a9-9434-66bbb151edad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.302518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ae1201bbc54bef84cfacc2b9d4559e', 'request_id': 'req-f68e9990-fcaf-45a9-9434-66bbb151edad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.315137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ae1201bbc54bef84cfacc2b9d4559e', 'request_id': 'req-f68e9990-fcaf-45a9-9434-66bbb151edad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.330587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] The token cache is being invalidate because project 50ae1201bbc54bef84cfacc2b9d4559e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:58:38.330885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.331603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.333759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 823/1647] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:58:38 2022] DELETE /identity/v3/projects/50ae1201bbc54bef84cfacc2b9d4559e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:38.338687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:38.342569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:38.385489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d06750-ab68-4f91-b1c4-002978d995b9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:38.498848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:38.499953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:38.501874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:38.503056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:38.504705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:38.507173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e9990-fcaf-45a9-9434-66bbb151edad admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:38.513684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.520219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:38.521258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:38.521540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:38.521815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] PATH_INFO: `/v3/users/c49c127a90e24ab1a4f506421eb44190` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:38.523256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49c127a90e24ab1a4f506421eb44190)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:38.524797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: WARNING py.warnings [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 09:58:38.524797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: warnings.warn(msg) Jun 21 09:58:38.524797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: Jun 21 09:58:38.527328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.537506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 825/1648] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:38.542026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:38.543566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:38.563042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:38.573511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7896c7-16ef-4f2f-96f7-d3783fe45e35 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:38.580759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:38.581850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:38.582243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:38.582983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] PATH_INFO: `/v3/projects/6d3f4cfbee1146d78f5886f063eafe9e/users/9181b0e46e5d431cae7bfa04c0e41b15/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:38.587015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3f4cfbee1146d78f5886f063eafe9e, user_id=9181b0e46e5d431cae7bfa04c0e41b15, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:38.590449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:38.625173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 826/1649] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:38 2022] PUT /identity/v3/projects/6d3f4cfbee1146d78f5886f063eafe9e/users/9181b0e46e5d431cae7bfa04c0e41b15/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:58:38.693516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49c127a90e24ab1a4f506421eb44190'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.738985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49c127a90e24ab1a4f506421eb44190'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.740321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49c127a90e24ab1a4f506421eb44190'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.765461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49c127a90e24ab1a4f506421eb44190'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.796759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1a012af8-5464-4205-bb0c-e5e0d0c8f9a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49c127a90e24ab1a4f506421eb44190'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:38.808377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 824/1650] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:58:38 2022] DELETE /identity/v3/users/c49c127a90e24ab1a4f506421eb44190 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:39.959461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:39.961811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:40.139429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:40.151265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19479f9-b4e9-4e10-9e0f-c3899f3eb36b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:40.255888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:40.257027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.257545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.257963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] PATH_INFO: `/v3/projects/e7ca45b5d2ed44ae8cbf8896f31330a4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.260025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ca45b5d2ed44ae8cbf8896f31330a4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:40.262338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:40.410608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ca45b5d2ed44ae8cbf8896f31330a4', 'request_id': 'req-7a1cb356-5dc4-46a0-9c00-b39201ec3711'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.430951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ca45b5d2ed44ae8cbf8896f31330a4', 'request_id': 'req-7a1cb356-5dc4-46a0-9c00-b39201ec3711'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.448643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ca45b5d2ed44ae8cbf8896f31330a4', 'request_id': 'req-7a1cb356-5dc4-46a0-9c00-b39201ec3711'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.468070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] The token cache is being invalidate because project e7ca45b5d2ed44ae8cbf8896f31330a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:58:40.468377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.469150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7a1cb356-5dc4-46a0-9c00-b39201ec3711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.475700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 827/1651] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:58:39 2022] DELETE /identity/v3/projects/e7ca45b5d2ed44ae8cbf8896f31330a4 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:40.480138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.480138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.480138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.518439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:40.519997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:40.695281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 825/1652] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:40.696535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.696917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.697463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.719682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:40.721480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:40.741561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 828/1653] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:40.746871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:40.754258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:40.763385 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7201d7-24f3-43ee-a6df-0a1711dc8fbb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:40.769340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:40.785156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:40.786554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.786951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.787376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.788561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:40.788955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:40.795342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:40.806943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49466d-9bc0-46a8-a600-88a506dac2fd None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:40.825843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:40.826817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.827115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.827655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] PATH_INFO: `/v3/projects/6e711771e86c47988068efb0610a4b9d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.829191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e711771e86c47988068efb0610a4b9d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:40.831967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:40.836886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 826/1654] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:40.842200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:40.867348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4759-5ea3-40e0-9a1c-743ccf851da3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:40.887894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:40.890135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.890533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e711771e86c47988068efb0610a4b9d', 'request_id': 'req-555ca7ac-f4c5-4163-b12e-fa604b18de50'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.890869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.891333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.893426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:40.899054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e711771e86c47988068efb0610a4b9d', 'request_id': 'req-555ca7ac-f4c5-4163-b12e-fa604b18de50'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.899500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:40.912377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e711771e86c47988068efb0610a4b9d', 'request_id': 'req-555ca7ac-f4c5-4163-b12e-fa604b18de50'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.934940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] The token cache is being invalidate because project 6e711771e86c47988068efb0610a4b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:58:40.935455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.940037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-555ca7ac-f4c5-4163-b12e-fa604b18de50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:40.957398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 829/1655] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:58:40 2022] DELETE /identity/v3/projects/6e711771e86c47988068efb0610a4b9d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:40.963296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c356-514d-4d3f-9c66-b7ad92b8df57 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:40.963890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c356-514d-4d3f-9c66-b7ad92b8df57 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:40.965733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5c356-514d-4d3f-9c66-b7ad92b8df57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:40.969714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 827/1656] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:40 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:40.973970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:40.979394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:41.016438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-47f5c356-514d-4d3f-9c66-b7ad92b8df57 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:41.018834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-47f5c356-514d-4d3f-9c66-b7ad92b8df57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:41.035389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:41.143899 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:41.148613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd76ebf-f4d6-4f9a-9283-deaf325b4824 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.157117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 830/1657] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:41.162200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.162491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.162777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.163052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.163744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.165257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.166110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.166405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.169649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.188143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:41.189639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:41.203007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 831/1658] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:41.204258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.211198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 828/1659] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:40 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:41.214460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.220025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c5947-2361-4257-a1c6-c0ad083fc02d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.225995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.227054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.227961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.229161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.230155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:41.230660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.237412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.242365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f537a-2d7f-453c-bc9d-ea39eb6dc4f1 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.247468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.248175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.248459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.248736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.249467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.251057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.263553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 832/1660] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:41.264845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.280761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 829/1661] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:41.281728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.283153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46189e3e-3bb1-40a0-bc91-6f9cfed9337f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.292457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.293546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.294863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.295495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.296640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.299419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.301807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784ced-7e5f-42e8-9287-ffdf6da29f38 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.316407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.317096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.317378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.317654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.318392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.320035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.341104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 833/1662] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:41.345027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.348535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 830/1663] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:41.356254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.375665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14887d7d-8cff-4f85-bcf5-9f407bc5d883 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.510061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba540f-3b29-417d-b438-c9a6e7563b97 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.513333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db7ce8-771a-4217-b757-779eb307b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.514531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7ce8-771a-4217-b757-779eb307b3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.514824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7ce8-771a-4217-b757-779eb307b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.515358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db7ce8-771a-4217-b757-779eb307b3a6 admin admin] PATH_INFO: `/v3/projects/a588f559b8fa49689e99cf4e2c42c1fb/users/79a8646c46f1440d85f226e4d8bd701c/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.516983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.517689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.517958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.518237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.518936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.520920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.536029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7ce8-771a-4217-b757-779eb307b3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a588f559b8fa49689e99cf4e2c42c1fb, user_id=79a8646c46f1440d85f226e4d8bd701c, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.539383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db7ce8-771a-4217-b757-779eb307b3a6 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.570704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 834/1665] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:41.572776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.577915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 831/1665] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:41 2022] PUT /identity/v3/projects/a588f559b8fa49689e99cf4e2c42c1fb/users/79a8646c46f1440d85f226e4d8bd701c/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:41.579817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.580253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.580539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.590100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dfc86-e70c-4d6e-a6f2-4a6940ef657a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.660162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] MFA Rules not processed for user `79a8646c46f1440d85f226e4d8bd701c`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:41.662183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:41.718414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.719244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.719382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.719663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.720422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.722018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.723845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:41.744766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 835/1666] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:41.752309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.767517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f9ec-709f-4b82-bb10-1083b5a97b3a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.778188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.779109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.779402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.781042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.784043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.788334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.808851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 836/1667] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:41.812740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.816262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 832/1668] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:41.820671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.833202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b110ab-ea8d-4b30-93ca-2d9133394bbb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.843866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f0496f-7bc4-47fb-9b66-1a9e3542d84a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:41.852986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6679dd-e456-4f6e-999d-550b47b78331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.854598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6679dd-e456-4f6e-999d-550b47b78331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.854884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6679dd-e456-4f6e-999d-550b47b78331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.855160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6679dd-e456-4f6e-999d-550b47b78331 admin admin] PATH_INFO: `/v3/projects/c318c218694943beb3fc66dfb262ee5f/users/4a23f19c51da4c378cca4eba7a28a4b3/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.863494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:41.864588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.865076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.865548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.866452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.868806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.887128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6679dd-e456-4f6e-999d-550b47b78331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c318c218694943beb3fc66dfb262ee5f, user_id=4a23f19c51da4c378cca4eba7a28a4b3, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:41.889973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6679dd-e456-4f6e-999d-550b47b78331 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:41.920140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 837/1669] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:41 2022] PUT /identity/v3/projects/c318c218694943beb3fc66dfb262ee5f/users/4a23f19c51da4c378cca4eba7a28a4b3/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:58:41.931615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:41.931938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:41.932305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:41.937025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 833/1670] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:41.941264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:41.986795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:41.989840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] MFA Rules not processed for user `4a23f19c51da4c378cca4eba7a28a4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:41.990772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:42.068921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5817264-d2b7-44f0-a1eb-58f394661213 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.074862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.075634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.076076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.076348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.077134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.079161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.127988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 838/1671] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:42.129437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.135366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 834/1672] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:41 2022] POST /identity/v3/users => generated 296 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:42.150127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb2d0-62b6-4dea-bdca-08732630852b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.151608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.163123 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.163809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.164677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.164677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.165083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.167766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.170348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da419d-ab31-49c0-869f-5731e0bbf400 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.183589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.184374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.184675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.184941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.186357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.188178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.225309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 835/1673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:42.225483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 839/1674] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:42 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:42.226937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.227049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.245478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898d7c9-3660-4e29-9178-5104435a070d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.355407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc336f-804b-4802-91a5-55d3167ede83 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.367039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.368467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.373863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.374413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] PATH_INFO: `/v3/projects/c8d071aedd2a40319e1c4761a8eb946a/users/1e33ef7da684460e805ef3e0fa53ce55/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.375008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.375715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.376072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.376296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.377147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.379132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.411752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d071aedd2a40319e1c4761a8eb946a, user_id=1e33ef7da684460e805ef3e0fa53ce55, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.417122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.424025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 840/1675] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:42 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:42.424968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.450620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db676808-5acf-4dbd-afa3-2313c6398b83 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.454171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 836/1676] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:42 2022] PUT /identity/v3/projects/c8d071aedd2a40319e1c4761a8eb946a/users/1e33ef7da684460e805ef3e0fa53ce55/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:42.459428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.480631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:42.572734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.573528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.573706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.573984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.574719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.576380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.597960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f0548-4245-465c-98b3-889f00001898 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.607159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 841/1677] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:42.608215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.608336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.608570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.609113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.609717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.611322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.614386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.626982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66563e-4a4e-42fe-be47-453ad92563ac admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.634915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 837/1678] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:42.636964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.639083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.640066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.640331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.640611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] PATH_INFO: `/v3/projects/09a08f64ea5e459dab1374f10ccc1e13/users/2dc5a97bd3f341808fda97eb72c9f5f4/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.669671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e03bb-e1ed-42e2-89dc-05d7501bf9c4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.672284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a08f64ea5e459dab1374f10ccc1e13, user_id=2dc5a97bd3f341808fda97eb72c9f5f4, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.675298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.676258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c952ccf-1b93-4955-bcba-951b76a9d1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.677263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c952ccf-1b93-4955-bcba-951b76a9d1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.678069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c952ccf-1b93-4955-bcba-951b76a9d1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.678069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c952ccf-1b93-4955-bcba-951b76a9d1b5 admin admin] PATH_INFO: `/v3/projects/c8d071aedd2a40319e1c4761a8eb946a/users/1e33ef7da684460e805ef3e0fa53ce55/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.680332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c952ccf-1b93-4955-bcba-951b76a9d1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d071aedd2a40319e1c4761a8eb946a, user_id=1e33ef7da684460e805ef3e0fa53ce55, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.684252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c952ccf-1b93-4955-bcba-951b76a9d1b5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.692176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:42.706605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 838/1679] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:42 2022] PUT /identity/v3/projects/c8d071aedd2a40319e1c4761a8eb946a/users/1e33ef7da684460e805ef3e0fa53ce55/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:42.709752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 842/1680] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:42 2022] PUT /identity/v3/projects/09a08f64ea5e459dab1374f10ccc1e13/users/2dc5a97bd3f341808fda97eb72c9f5f4/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:58:42.720753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:42.721260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.722436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.725991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.827470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] MFA Rules not processed for user `9181b0e46e5d431cae7bfa04c0e41b15`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:42.834336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:42.872373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc44be-af70-4bbb-94df-bfa1128ea66b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:42.893450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9cf31-b213-4af6-98be-a6a04eef3702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:42.894307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9cf31-b213-4af6-98be-a6a04eef3702 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.894715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9cf31-b213-4af6-98be-a6a04eef3702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.895122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9cf31-b213-4af6-98be-a6a04eef3702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.896021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9cf31-b213-4af6-98be-a6a04eef3702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:42.898288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9cf31-b213-4af6-98be-a6a04eef3702 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:42.911717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 843/1681] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:42.915673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:42.923951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:42.924689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:42.965579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] MFA Rules not processed for user `1e33ef7da684460e805ef3e0fa53ce55`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:42.970052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:43.067921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 839/1682] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:43.068948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:43.107902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad147f-7b7b-4cfc-9f40-aa23328e4069 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:43.120959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995344e-a49f-4490-970b-7904d269c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:43.122040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995344e-a49f-4490-970b-7904d269c1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:43.122336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995344e-a49f-4490-970b-7904d269c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:43.122619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995344e-a49f-4490-970b-7904d269c1aa admin admin] PATH_INFO: `/v3/projects/09a08f64ea5e459dab1374f10ccc1e13/users/2dc5a97bd3f341808fda97eb72c9f5f4/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:43.136004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995344e-a49f-4490-970b-7904d269c1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a08f64ea5e459dab1374f10ccc1e13, user_id=2dc5a97bd3f341808fda97eb72c9f5f4, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:43.146702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 844/1683] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:43.147175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995344e-a49f-4490-970b-7904d269c1aa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:43.156430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:43.157884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:43.178629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:43.195695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 840/1684] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:43 2022] PUT /identity/v3/projects/09a08f64ea5e459dab1374f10ccc1e13/users/2dc5a97bd3f341808fda97eb72c9f5f4/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:43.198644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:43.198945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:43.199229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:43.290616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86833f44-f5a2-4cd1-b562-f06987d78c10 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:43.292584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] MFA Rules not processed for user `2dc5a97bd3f341808fda97eb72c9f5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:43.293866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:43.406323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:43.406948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:43.407234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:43.407510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:43.478725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 841/1685] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:43.487496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:43.489038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:43.518350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0f3fe-cb45-4c7b-b8b6-9b34cf5cd169 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:43.531418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ca576-831b-4448-8c2b-062a6e9f9769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:43.531418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ca576-831b-4448-8c2b-062a6e9f9769 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:43.533293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:43.533418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ca576-831b-4448-8c2b-062a6e9f9769 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:43.533674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ca576-831b-4448-8c2b-062a6e9f9769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:43.536557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:43.564553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 845/1686] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:43.719636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:43.728653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ca576-831b-4448-8c2b-062a6e9f9769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:43.731518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ca576-831b-4448-8c2b-062a6e9f9769 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:43.763682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 842/1687] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:43.784826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:43.794727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf15ce9-a89a-4958-9cdf-acfbdda0b1aa service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:43.812308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfade8d5-d5d4-47b4-b79e-ff663d9f02f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:43.812991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfade8d5-d5d4-47b4-b79e-ff663d9f02f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:43.813273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfade8d5-d5d4-47b4-b79e-ff663d9f02f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:43.813551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfade8d5-d5d4-47b4-b79e-ff663d9f02f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:44.002671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfade8d5-d5d4-47b4-b79e-ff663d9f02f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:44.004398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfade8d5-d5d4-47b4-b79e-ff663d9f02f1 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:44.031583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 846/1688] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:46.787104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787d4c-200f-401d-ab0e-cde1760ff50d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:46.787937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787d4c-200f-401d-ab0e-cde1760ff50d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:46.788592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787d4c-200f-401d-ab0e-cde1760ff50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:46.857440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-35787d4c-200f-401d-ab0e-cde1760ff50d None None] MFA Rules not processed for user `8c1def94f6364acd9da7f7e0654bc8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:46.864021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-35787d4c-200f-401d-ab0e-cde1760ff50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:47.005716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 843/1689] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:47.011321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784198b8-cba5-4585-8758-690d70147092 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.011816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784198b8-cba5-4585-8758-690d70147092 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.012131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784198b8-cba5-4585-8758-690d70147092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.031706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-784198b8-cba5-4585-8758-690d70147092 None None] MFA Rules not processed for user `8c1def94f6364acd9da7f7e0654bc8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:47.033280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-784198b8-cba5-4585-8758-690d70147092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:47.045266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 847/1690] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:47.084364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301dce-70b0-4cb8-ae38-3c48ca8f1386 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.084739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301dce-70b0-4cb8-ae38-3c48ca8f1386 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.085221 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301dce-70b0-4cb8-ae38-3c48ca8f1386 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.091768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 844/1691] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 09:58:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:58:47.101663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f60b-2504-4b70-8437-8f53aaa8b25a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.103199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f60b-2504-4b70-8437-8f53aaa8b25a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.103199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f60b-2504-4b70-8437-8f53aaa8b25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.125430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2917f60b-2504-4b70-8437-8f53aaa8b25a None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:47.126638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2917f60b-2504-4b70-8437-8f53aaa8b25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:47.131798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:47.239510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b301dce-70b0-4cb8-ae38-3c48ca8f1386 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:47.242703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 848/1692] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:47.260746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b301dce-70b0-4cb8-ae38-3c48ca8f1386 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:47.268243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f78403-507c-4dbc-8378-5eb73ae9b96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:47.269473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78403-507c-4dbc-8378-5eb73ae9b96d service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.269970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78403-507c-4dbc-8378-5eb73ae9b96d service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.270834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f78403-507c-4dbc-8378-5eb73ae9b96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.284306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f78403-507c-4dbc-8378-5eb73ae9b96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:47.286973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f78403-507c-4dbc-8378-5eb73ae9b96d service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:47.323166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 845/1693] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:47.601600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e5d6-6e0d-4cec-8e69-7eb6adcbf34e None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.602285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e5d6-6e0d-4cec-8e69-7eb6adcbf34e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.602833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e5d6-6e0d-4cec-8e69-7eb6adcbf34e None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.605790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 849/1694] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:58:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:58:47.696408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.697555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.697555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.749744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:47.751076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:47.974864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8523-19dd-49fe-9fdf-24e5356f7ce2 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:47.975304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8523-19dd-49fe-9fdf-24e5356f7ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:47.975700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a8523-19dd-49fe-9fdf-24e5356f7ce2 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:47.979349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 850/1695] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 09:58:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:58:48.004333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96583c8-3585-4957-837d-739fd5ff7659 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:48.004815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96583c8-3585-4957-837d-739fd5ff7659 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:48.004929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96583c8-3585-4957-837d-739fd5ff7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:48.007821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 846/1696] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:48.059270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f96583c8-3585-4957-837d-739fd5ff7659 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:48.060447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f96583c8-3585-4957-837d-739fd5ff7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:48.102244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 851/1697] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:48.119404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:48.125368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:48.154964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6b2fe-c29e-40ac-9ee3-09e8ce5a6357 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:48.155560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6b2fe-c29e-40ac-9ee3-09e8ce5a6357 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:48.156066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6b2fe-c29e-40ac-9ee3-09e8ce5a6357 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:48.158226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 852/1698] 10.222.0.36 () {54 vars in 960 bytes} [Tue Jun 21 09:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 09:58:48.167758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:48.169492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:48.170029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:48.192951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:48.194590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:48.207223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 853/1699] 10.222.0.36 () {58 vars in 1057 bytes} [Tue Jun 21 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:48.216937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:48.238878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e09aca-2258-4860-8d9c-535a369a4e01 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:48.251628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b4674-4498-4f5f-847b-14cc41306a4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:48.252488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b4674-4498-4f5f-847b-14cc41306a4e service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:48.253578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b4674-4498-4f5f-847b-14cc41306a4e service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:48.253961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b4674-4498-4f5f-847b-14cc41306a4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:48.271823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27077f-05d5-4caa-8083-d41b0a2e9137 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:48.282167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b4674-4498-4f5f-847b-14cc41306a4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:48.286141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b4674-4498-4f5f-847b-14cc41306a4e service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:48.287064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca6220-cc85-4153-8a2b-85b614ee6b6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:48.288339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6220-cc85-4153-8a2b-85b614ee6b6f service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:48.289322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6220-cc85-4153-8a2b-85b614ee6b6f service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:48.294298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca6220-cc85-4153-8a2b-85b614ee6b6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:48.325971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 854/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:48.340159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6220-cc85-4153-8a2b-85b614ee6b6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:48.341645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca6220-cc85-4153-8a2b-85b614ee6b6f service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:48.370332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 847/1701] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:49.272980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634288bd-377b-4a7f-a2d4-79b37dcbc0e3 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:49.273479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634288bd-377b-4a7f-a2d4-79b37dcbc0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:49.273583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634288bd-377b-4a7f-a2d4-79b37dcbc0e3 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:49.276476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 855/1702] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 09:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:58:49.282178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:49.283130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:49.283638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:49.323757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:49.351429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:49.353291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:49.460519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 848/1703] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 09:58:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:49.727494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634288bd-377b-4a7f-a2d4-79b37dcbc0e3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:49.732253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-634288bd-377b-4a7f-a2d4-79b37dcbc0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:49.767627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634288bd-377b-4a7f-a2d4-79b37dcbc0e3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:49.783883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ee5f-64dc-410e-8cc7-1ecb5fd96797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:49.785099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ee5f-64dc-410e-8cc7-1ecb5fd96797 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:49.786167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ee5f-64dc-410e-8cc7-1ecb5fd96797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:49.786646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ee5f-64dc-410e-8cc7-1ecb5fd96797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:49.797335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39ee5f-64dc-410e-8cc7-1ecb5fd96797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:49.799758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39ee5f-64dc-410e-8cc7-1ecb5fd96797 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:49.823282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 856/1704] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:50.315461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:50.329503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958b05a-4597-434d-b11d-314f25ba75ec None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:50.341031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bece732-1aec-411a-8ce1-57db9f8ee36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:50.341838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece732-1aec-411a-8ce1-57db9f8ee36f service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:50.342248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece732-1aec-411a-8ce1-57db9f8ee36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:50.342637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece732-1aec-411a-8ce1-57db9f8ee36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:50.370392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bece732-1aec-411a-8ce1-57db9f8ee36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:50.372167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bece732-1aec-411a-8ce1-57db9f8ee36f service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:50.386004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 849/1705] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:50.716117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6ef51-40cd-49f6-b452-f7f87ada46ae None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:50.717466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6ef51-40cd-49f6-b452-f7f87ada46ae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:50.718078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6ef51-40cd-49f6-b452-f7f87ada46ae None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:50.720605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 857/1706] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:58:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:58:50.800984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:50.801441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:50.801938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:50.856143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] MFA Rules not processed for user `794d74faad1d449e8a4253b21f01e050`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:50.860517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:50.894672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 850/1707] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:58:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:50.980231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6ef51-40cd-49f6-b452-f7f87ada46ae None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:51.017787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6ef51-40cd-49f6-b452-f7f87ada46ae None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:51.050145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:51.054478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:51.055495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:51.057062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:51.066930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:51.069189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:51.113029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:51.114660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:51.138982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 858/1708] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:51.186848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90930b53-1b3c-423a-9577-3a6214b51d2e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:51.192916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:51.193829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:51.194117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:51.194410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] PATH_INFO: `/v3/users/19b1e3fad13b442ab98fbb7b684dcfa0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:51.195849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b1e3fad13b442ab98fbb7b684dcfa0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:51.198284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:51.290123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b1e3fad13b442ab98fbb7b684dcfa0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:51.309190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b1e3fad13b442ab98fbb7b684dcfa0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:51.311052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b1e3fad13b442ab98fbb7b684dcfa0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:51.321644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b1e3fad13b442ab98fbb7b684dcfa0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:51.352185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b1e3fad13b442ab98fbb7b684dcfa0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:51.375136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 851/1709] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:58:51 2022] DELETE /identity/v3/users/19b1e3fad13b442ab98fbb7b684dcfa0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:52.174416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:52.193110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a302bd6-e91e-4104-a4bb-e4ece3b8468a service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:52.445473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:52.446252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:52.448894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:52.449248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:52.453016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:52.470668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:52.473495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d4b72-8560-49a1-85d9-723fdcc46652 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:52.496918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:52.498480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:52.499694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 859/1710] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:52.505983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaa4f2-ed44-4d27-9171-6157e43699c0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:52.506274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaa4f2-ed44-4d27-9171-6157e43699c0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:52.506564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedaa4f2-ed44-4d27-9171-6157e43699c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:52.513626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:52.607722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aedaa4f2-ed44-4d27-9171-6157e43699c0 None None] MFA Rules not processed for user `1fde108762d645bc9c5c5791dfe646a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:52.609026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aedaa4f2-ed44-4d27-9171-6157e43699c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:52.631779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94585d4-eea4-4e84-98d8-9db3435e5246 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:52.639943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:52.641071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:52.641425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:52.641772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] PATH_INFO: `/v3/projects/e97807e604d54109a383181e4c5c3400` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:52.643229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e97807e604d54109a383181e4c5c3400)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:52.645299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:52.698055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:52.738890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e97807e604d54109a383181e4c5c3400', 'request_id': 'req-edc78f86-4701-401e-936f-aaad1d600ccd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:52.753978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e97807e604d54109a383181e4c5c3400', 'request_id': 'req-edc78f86-4701-401e-936f-aaad1d600ccd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:52.773641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e97807e604d54109a383181e4c5c3400', 'request_id': 'req-edc78f86-4701-401e-936f-aaad1d600ccd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:52.794540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] The token cache is being invalidate because project e97807e604d54109a383181e4c5c3400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:58:52.794927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:52.796752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-edc78f86-4701-401e-936f-aaad1d600ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:52.802334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 852/1711] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:58:52 2022] DELETE /identity/v3/projects/e97807e604d54109a383181e4c5c3400 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:58:52.803855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdcff0-f82b-4e66-9d68-1408d122102d None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:52.805741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdcff0-f82b-4e66-9d68-1408d122102d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:52.806888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdcff0-f82b-4e66-9d68-1408d122102d None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:52.809105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 853/1712] 10.222.0.36 () {54 vars in 961 bytes} [Tue Jun 21 09:58:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:58:52.809231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdcff0-f82b-4e66-9d68-1408d122102d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:52.817753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 860/1713] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:52.817753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:52.817753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:52.818059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fcbdcff0-f82b-4e66-9d68-1408d122102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:52.819069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:52.860977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:52.864074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:52.985628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdcff0-f82b-4e66-9d68-1408d122102d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:52.994049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:52.995275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:52.995715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:52.996715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] PATH_INFO: `/v3/users/9181b0e46e5d431cae7bfa04c0e41b15` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:52.998475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9181b0e46e5d431cae7bfa04c0e41b15)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:53.001906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:53.052543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 861/1714] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Jun 21 09:58:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:53.058895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:53.064428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.097738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa60108-86a0-4f3a-8242-ed63b408c484 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:53.112866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:53.122779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:53.126028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9181b0e46e5d431cae7bfa04c0e41b15'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:53.126443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.127696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.128171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.132657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.160829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9181b0e46e5d431cae7bfa04c0e41b15'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:53.162537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9181b0e46e5d431cae7bfa04c0e41b15'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:53.181754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9181b0e46e5d431cae7bfa04c0e41b15'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:53.201294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-25fd3830-c363-4f39-94f4-73141b78c3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9181b0e46e5d431cae7bfa04c0e41b15'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:53.215696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 854/1715] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:58:52 2022] DELETE /identity/v3/users/9181b0e46e5d431cae7bfa04c0e41b15 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:53.234793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe3c1b-4ce3-4147-ba6a-6934700061ae None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.235155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe3c1b-4ce3-4147-ba6a-6934700061ae None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.235432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe3c1b-4ce3-4147-ba6a-6934700061ae None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.244219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 855/1716] 10.222.0.36 () {54 vars in 912 bytes} [Tue Jun 21 09:58:53 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:58:53.251316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9017f-8c34-44da-bb9c-f30807ce4f02 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.251921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9017f-8c34-44da-bb9c-f30807ce4f02 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.252532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9017f-8c34-44da-bb9c-f30807ce4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.279645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-57f9017f-8c34-44da-bb9c-f30807ce4f02 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:53.281602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-57f9017f-8c34-44da-bb9c-f30807ce4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.319621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:53.321294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:53.351793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 862/1717] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:53.429545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 856/1718] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 09:58:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:53.495347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:53.495744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02860993-fdd6-4ee1-aad3-7768b16d2d6a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.496066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02860993-fdd6-4ee1-aad3-7768b16d2d6a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.496349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02860993-fdd6-4ee1-aad3-7768b16d2d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.498519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.567764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-02860993-fdd6-4ee1-aad3-7768b16d2d6a None None] MFA Rules not processed for user `7e98533664dd4bf6b90e471fc42ba41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:53.569066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-02860993-fdd6-4ee1-aad3-7768b16d2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.617134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2330df9-b024-4426-90ed-72600caaddf5 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:53.632678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:53.714722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:53.715989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.717129 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.717476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.742067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 857/1719] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:53.752895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:53.754045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.754356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:53.754721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.755197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.799546 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] MFA Rules not processed for user `7e98533664dd4bf6b90e471fc42ba41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:53.803227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.803493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 863/1720] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:53.804885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:53.808353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.838269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 858/1721] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:53.850769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:53.852213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:53.931381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd459d3-51f3-4fe8-94fe-5573c93582a9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:53.957875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e314b-3648-4b2d-b786-015427fbde44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:53.957875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e314b-3648-4b2d-b786-015427fbde44 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:53.958193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e314b-3648-4b2d-b786-015427fbde44 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:53.958388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e314b-3648-4b2d-b786-015427fbde44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:53.994342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e314b-3648-4b2d-b786-015427fbde44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:54.008184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e314b-3648-4b2d-b786-015427fbde44 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:54.050071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432675c-884e-422e-b161-6fef1414dcb8 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:54.058454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:54.059143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:54.059435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:54.059701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] PATH_INFO: `/v3/projects/6d3f4cfbee1146d78f5886f063eafe9e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:54.060959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3f4cfbee1146d78f5886f063eafe9e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:54.062664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 859/1722] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:54.062931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:54.190084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3f4cfbee1146d78f5886f063eafe9e', 'request_id': 'req-1225fdf7-bc56-4dd7-be6f-1bb61c113851'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:54.221971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3f4cfbee1146d78f5886f063eafe9e', 'request_id': 'req-1225fdf7-bc56-4dd7-be6f-1bb61c113851'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:54.246663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3f4cfbee1146d78f5886f063eafe9e', 'request_id': 'req-1225fdf7-bc56-4dd7-be6f-1bb61c113851'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:54.269407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] The token cache is being invalidate because project 6d3f4cfbee1146d78f5886f063eafe9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:58:54.269938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:54.273192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1225fdf7-bc56-4dd7-be6f-1bb61c113851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:58:54.276176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 864/1723] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:58:53 2022] DELETE /identity/v3/projects/6d3f4cfbee1146d78f5886f063eafe9e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:54.281323 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:54.281709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:54.282122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:54.324260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:54.325535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:54.370228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:54.501201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 860/1724] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:54.510133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:54.510728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:54.510728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:54.557151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:54.562170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:54.593773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 865/1725] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:54.600069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:54.618645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe934-9c1d-4e03-8c77-1f4e6f71838e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:54.658951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:54.663639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:54.664140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:54.664775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:54.668650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:58:54.670848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:54.674311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:54.714654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 861/1726] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:58:54.716166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:54.736335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e5d4c-5b07-4e2a-9f8e-402f6876e5af None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:54.754164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:54.755169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:54.755635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:54.756138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:54.757165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:54.763053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:54.820790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 866/1727] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:54 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:54.826020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:54.843301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efe624-0622-4bdb-b6b4-6d91e513db11 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:55.031862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:55.032743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:55.033069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:55.033356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:55.034202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:55.036257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:55.114869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:55.117282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 862/1728] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:54 2022] POST /identity/v3/users => generated 282 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:55.136092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f6804-740b-4aa6-bfd2-0b895e073fa6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:55.160914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:55.161723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:55.162130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:55.162620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:55.163568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:55.174049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:55.219347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 867/1729] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:58:55.219875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:55.237547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5b20-4c6f-4033-8cf3-2258fcb983c8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:55.251634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784717a-8086-4b4b-a70c-a3f621f12b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:55.259736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784717a-8086-4b4b-a70c-a3f621f12b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:55.261408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784717a-8086-4b4b-a70c-a3f621f12b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:55.261857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784717a-8086-4b4b-a70c-a3f621f12b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:55.264400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784717a-8086-4b4b-a70c-a3f621f12b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:55.266261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784717a-8086-4b4b-a70c-a3f621f12b57 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:55.298987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 863/1730] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:58:55.299838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:55.323069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce68e-2de5-44fa-9089-e41839836de3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:55.339075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:55.340014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:55.340489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:55.340924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] PATH_INFO: `/v3/projects/d4d9c9a639b5480b856e26a81adb5b2b/users/faed830c30b84dbca36de0532d5498ad/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:55.344406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:55.380630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d9c9a639b5480b856e26a81adb5b2b, user_id=faed830c30b84dbca36de0532d5498ad, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:55.384902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:55.438201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 868/1731] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:55 2022] PUT /identity/v3/projects/d4d9c9a639b5480b856e26a81adb5b2b/users/faed830c30b84dbca36de0532d5498ad/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:58:55.448931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:55.449223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:55.449502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:55.508827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] MFA Rules not processed for user `faed830c30b84dbca36de0532d5498ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:55.510784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:55.779037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 864/1732] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:55.779672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:56.035156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2c42-2085-4d4c-9066-df8e1621bba3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:56.071031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:56.073549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.074012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.074453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.075327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:56.077487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:56.157786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 869/1733] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:58:55 2022] POST /identity/v3/projects => generated 365 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:58:56.159184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:56.179327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb6568-1e3c-4812-ba0c-f9a98ad72f2b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:56.208033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:56.300870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:56.301753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.302539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.302539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.304825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:56.308567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:56.365829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:56.373083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 865/1734] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:58:56 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:58:56.388617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d3b58-948f-4046-b02a-b49588637aee admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:56.394026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:56.394875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.395256 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.396653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.397804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:56.402780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:56.440803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:56.455214 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966db1a-5e6a-4d58-9543-218a1bc27b8e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:56.455423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 870/1735] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:58:56.466855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:56.468999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.474927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.475410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] PATH_INFO: `/v3/projects/c8315348aa064358ae77fa3b00c1ebbd/users/f71eaa7f94e14b8f89911a7773c01ea0/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.521517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8315348aa064358ae77fa3b00c1ebbd, user_id=f71eaa7f94e14b8f89911a7773c01ea0, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:56.535078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:56.578375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:56.590052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 866/1736] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:56 2022] PUT /identity/v3/projects/c8315348aa064358ae77fa3b00c1ebbd/users/f71eaa7f94e14b8f89911a7773c01ea0/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:58:56.600532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00104e70-9290-4952-b30e-2e30d5394c51 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:56.695041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef6956-5839-4fe7-b08c-1f4f0e602e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:56.696620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6956-5839-4fe7-b08c-1f4f0e602e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.697130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6956-5839-4fe7-b08c-1f4f0e602e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.697618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef6956-5839-4fe7-b08c-1f4f0e602e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.699359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef6956-5839-4fe7-b08c-1f4f0e602e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:56.701334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef6956-5839-4fe7-b08c-1f4f0e602e81 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:56.717221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 871/1737] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:58:56.721017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:56.741831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb7348-fb97-403a-89c7-b6b77c3ca778 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:56.753894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:56.756359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.756940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.757436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] PATH_INFO: `/v3/projects/c8315348aa064358ae77fa3b00c1ebbd/users/f71eaa7f94e14b8f89911a7773c01ea0/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.767699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8315348aa064358ae77fa3b00c1ebbd, user_id=f71eaa7f94e14b8f89911a7773c01ea0, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:56.776091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:56.820978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 867/1738] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:58:56 2022] PUT /identity/v3/projects/c8315348aa064358ae77fa3b00c1ebbd/users/f71eaa7f94e14b8f89911a7773c01ea0/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:58:56.832244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ea13-bc03-4eee-8c45-32f274314fe8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:56.833144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ea13-bc03-4eee-8c45-32f274314fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:56.833585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178ea13-bc03-4eee-8c45-32f274314fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:56.920432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c178ea13-bc03-4eee-8c45-32f274314fe8 None None] MFA Rules not processed for user `f71eaa7f94e14b8f89911a7773c01ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:56.929370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c178ea13-bc03-4eee-8c45-32f274314fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:57.084487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:57.238644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 872/1739] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:57.250570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:57.253290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:57.535243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:57.536252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:57.537217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:57.547424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19caca48-4402-4af3-805f-7fb9be83fe3f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:57.585910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9c8b5-9cd3-422b-a472-bb7ed05ee776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:57.587988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c8b5-9cd3-422b-a472-bb7ed05ee776 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:57.596347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c8b5-9cd3-422b-a472-bb7ed05ee776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:57.598361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9c8b5-9cd3-422b-a472-bb7ed05ee776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:57.640881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9c8b5-9cd3-422b-a472-bb7ed05ee776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:57.645187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] MFA Rules not processed for user `7e98533664dd4bf6b90e471fc42ba41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:57.646431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:57.647194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9c8b5-9cd3-422b-a472-bb7ed05ee776 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:57.687494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 868/1740] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:57.700100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:57.700766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:57.701325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:57.753817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] MFA Rules not processed for user `d3d76c556b5f41f19c1a2a466a031cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:57.756851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:57.879328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 873/1741] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:58:57.904573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:57.925388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 869/1742] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:57.934109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:57.935832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:58.232384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:58.233817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:58.252466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe43d7-9e37-457b-9062-c564d79dcee6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:58.262266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886084f9-0d62-4d1b-b22b-9c337e43999f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:58.275960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183c3e0-0a1c-4092-8813-77e65504eeaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:58.279646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c3e0-0a1c-4092-8813-77e65504eeaa service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:58.280491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddb71-8f2b-42f3-8e6e-4dbe8110cda4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:58.280970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c3e0-0a1c-4092-8813-77e65504eeaa service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:58.282167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183c3e0-0a1c-4092-8813-77e65504eeaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:58.282996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddb71-8f2b-42f3-8e6e-4dbe8110cda4 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:58.285636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddb71-8f2b-42f3-8e6e-4dbe8110cda4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:58.285929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddb71-8f2b-42f3-8e6e-4dbe8110cda4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:58.322760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183c3e0-0a1c-4092-8813-77e65504eeaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:58.324862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183c3e0-0a1c-4092-8813-77e65504eeaa service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:58.362783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 874/1743] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:58:58.558598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddb71-8f2b-42f3-8e6e-4dbe8110cda4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:58.560517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddb71-8f2b-42f3-8e6e-4dbe8110cda4 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:58.595767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 870/1744] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:58:58.900314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fc55-43f2-4ff9-8c1f-2b3f1860dd78 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:58.900877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fc55-43f2-4ff9-8c1f-2b3f1860dd78 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:58.901150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45fc55-43f2-4ff9-8c1f-2b3f1860dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:58.965458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6e45fc55-43f2-4ff9-8c1f-2b3f1860dd78 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:58.969300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6e45fc55-43f2-4ff9-8c1f-2b3f1860dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:59.213981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 875/1745] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 09:58:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:59.240049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:59.241286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:59.241834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:59.326934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:59.328459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:59.467137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 871/1746] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 09:58:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:59.516225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:59.516798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:59.517700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:59.541375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:59.543117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:59.593779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] MFA Rules not processed for user `1fde108762d645bc9c5c5791dfe646a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:58:59.601488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:59.624974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:58:59.708840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb81a9f-cda2-4285-9246-97c5b5dd766c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:59.732777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:59.733466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:59.733752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:59.734027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:59.749587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:59.751230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:58:59.752219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 876/1747] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:58:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:58:59.753672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:58:59.755344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:58:59.780286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 872/1748] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 09:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 09:58:59.885190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b4efd-c3be-4099-83fd-54fd517b9c32 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:58:59.928499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258ad41-8af4-43b3-9ff7-291e251e5bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:58:59.931629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ad41-8af4-43b3-9ff7-291e251e5bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:58:59.931902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ad41-8af4-43b3-9ff7-291e251e5bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:58:59.932258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258ad41-8af4-43b3-9ff7-291e251e5bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:58:59.981417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258ad41-8af4-43b3-9ff7-291e251e5bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:58:59.987177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258ad41-8af4-43b3-9ff7-291e251e5bbf service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:00.022932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 877/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:58:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:00.506388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:00.507918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:00.651550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:00.738796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9fc3e-69b3-453c-80be-465d859896d8 service swift] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:00.752782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:00.754010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:00.754567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:00.755140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] PATH_INFO: `/v3/users/79a8646c46f1440d85f226e4d8bd701c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:00.756742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a8646c46f1440d85f226e4d8bd701c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:00.758941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:00.954154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a8646c46f1440d85f226e4d8bd701c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:00.985803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a8646c46f1440d85f226e4d8bd701c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:00.987935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a8646c46f1440d85f226e4d8bd701c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:01.002100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a8646c46f1440d85f226e4d8bd701c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:01.012089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a8646c46f1440d85f226e4d8bd701c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:01.024372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 873/1750] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:00 2022] DELETE /identity/v3/users/79a8646c46f1440d85f226e4d8bd701c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:01.026290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b95f05-0229-46e4-9940-b71a1f7e7e97 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:01.027110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b95f05-0229-46e4-9940-b71a1f7e7e97 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:01.027397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b95f05-0229-46e4-9940-b71a1f7e7e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:01.090221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-36b95f05-0229-46e4-9940-b71a1f7e7e97 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:01.094271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-36b95f05-0229-46e4-9940-b71a1f7e7e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:01.560004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 878/1751] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:01.593977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:01.596062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:01.733209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b9a9b-7611-4deb-aabf-263f6030c054 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:01.748318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:01.748318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:01.748318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:01.748318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:01.760981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:01.762586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:01.776604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 874/1752] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:01.848864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:01.849152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:01.849502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:01.964756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] MFA Rules not processed for user `bf85b80a4bb747da9bd07454536380c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:01.965842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:02.148271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 879/1753] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:02.165775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:02.167431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:02.290821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:02.322306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485f4c0-6486-4752-ba7e-4d9a88b3d1ab service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:02.328804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ff59c-af4e-4515-9c38-f768603dbc10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:02.329510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff59c-af4e-4515-9c38-f768603dbc10 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:02.329850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff59c-af4e-4515-9c38-f768603dbc10 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:02.330130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ff59c-af4e-4515-9c38-f768603dbc10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:02.340860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff59c-af4e-4515-9c38-f768603dbc10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:02.342481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ff59c-af4e-4515-9c38-f768603dbc10 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:02.355245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 875/1754] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:02.854168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:02.856111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:02.919233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785597a-eede-43c6-97c1-802ba836f786 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:02.930001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:02.931547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:02.931897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:02.940044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] PATH_INFO: `/v3/projects/a588f559b8fa49689e99cf4e2c42c1fb` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:02.940044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a588f559b8fa49689e99cf4e2c42c1fb)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:02.940044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:03.067896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:03.116753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a588f559b8fa49689e99cf4e2c42c1fb', 'request_id': 'req-8daf1557-fca7-4637-b089-c2f6192751e0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.129087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:03.129666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:03.129666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:03.139062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a588f559b8fa49689e99cf4e2c42c1fb', 'request_id': 'req-8daf1557-fca7-4637-b089-c2f6192751e0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.160563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a588f559b8fa49689e99cf4e2c42c1fb', 'request_id': 'req-8daf1557-fca7-4637-b089-c2f6192751e0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.192720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] The token cache is being invalidate because project a588f559b8fa49689e99cf4e2c42c1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:03.194258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.200276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.201163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:03.203354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:03.211644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 880/1755] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:02 2022] DELETE /identity/v3/projects/a588f559b8fa49689e99cf4e2c42c1fb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:03.216287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:03.219443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:03.497484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 876/1756] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jun 21 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:03.506186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf1557-fca7-4637-b089-c2f6192751e0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:03.526088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:03.527343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:03.529818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:03.530323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] PATH_INFO: `/v3/users/1e33ef7da684460e805ef3e0fa53ce55` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:03.533912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e33ef7da684460e805ef3e0fa53ce55)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:03.538647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:03.549320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:03.550838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:03.569394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646f227-da72-4864-b81b-b5b3d0d3dec1 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:03.585901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:03.588751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:03.589044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:03.589330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:03.612794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:03.614337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:03.654344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 877/1757] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:03.655522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e33ef7da684460e805ef3e0fa53ce55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.717498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e33ef7da684460e805ef3e0fa53ce55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.746899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e33ef7da684460e805ef3e0fa53ce55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.772359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:03.774439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:03.784251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e33ef7da684460e805ef3e0fa53ce55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.785127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a2238645-1d94-414a-8af4-812d5aba6ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e33ef7da684460e805ef3e0fa53ce55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:03.816107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 881/1758] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:03 2022] DELETE /identity/v3/users/1e33ef7da684460e805ef3e0fa53ce55 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:03.845401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7dcb60-65ad-423c-b624-fa3dd55d474c service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:03.937169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:03.938095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:03.938379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:03.938707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] PATH_INFO: `/v3/users/faed830c30b84dbca36de0532d5498ad` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:03.940415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=faed830c30b84dbca36de0532d5498ad)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:03.942651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:04.026774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faed830c30b84dbca36de0532d5498ad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:04.041517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faed830c30b84dbca36de0532d5498ad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:04.042316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faed830c30b84dbca36de0532d5498ad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:04.092919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faed830c30b84dbca36de0532d5498ad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:04.122324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faed830c30b84dbca36de0532d5498ad'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:04.124255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:04.137088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 878/1759] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:03 2022] DELETE /identity/v3/users/faed830c30b84dbca36de0532d5498ad => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:04.141426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cadaca-8777-471d-aeec-e3b2b5e7a257 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:04.142105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cadaca-8777-471d-aeec-e3b2b5e7a257 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:04.142596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cadaca-8777-471d-aeec-e3b2b5e7a257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:04.196117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e5cadaca-8777-471d-aeec-e3b2b5e7a257 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:04.252489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e5cadaca-8777-471d-aeec-e3b2b5e7a257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:04.367747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:04.484237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 882/1760] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:04.614847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:04.617454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:04.822359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d2a43-d924-47e7-8868-7e2dda993b7c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:04.832293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:04.833999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:04.834532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:04.835068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:04.860153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:04.867824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:04.912181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 879/1761] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:05.221886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f6ef-fc20-4f3b-98be-a08e24d68d04 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:05.222989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f6ef-fc20-4f3b-98be-a08e24d68d04 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:05.223489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f6ef-fc20-4f3b-98be-a08e24d68d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:05.275775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6832f6ef-fc20-4f3b-98be-a08e24d68d04 None None] MFA Rules not processed for user `d3d76c556b5f41f19c1a2a466a031cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:05.280711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6832f6ef-fc20-4f3b-98be-a08e24d68d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:05.516782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 883/1762] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:05.818534 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:05.821294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:05.849981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f01b3-180c-4c19-917e-1f6cb4038248 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:05.873540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:05.874569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:05.874861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:05.876365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] PATH_INFO: `/v3/projects/c8d071aedd2a40319e1c4761a8eb946a` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:05.880945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d071aedd2a40319e1c4761a8eb946a)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:05.887817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:06.036506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d071aedd2a40319e1c4761a8eb946a', 'request_id': 'req-836655c3-202a-4b94-9953-c179027c6a8c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:06.049700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d071aedd2a40319e1c4761a8eb946a', 'request_id': 'req-836655c3-202a-4b94-9953-c179027c6a8c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:06.068257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d071aedd2a40319e1c4761a8eb946a', 'request_id': 'req-836655c3-202a-4b94-9953-c179027c6a8c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:06.090036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] The token cache is being invalidate because project c8d071aedd2a40319e1c4761a8eb946a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:06.092128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:06.093770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-836655c3-202a-4b94-9953-c179027c6a8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:06.104787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 880/1763] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:05 2022] DELETE /identity/v3/projects/c8d071aedd2a40319e1c4761a8eb946a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:06.110349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:06.110349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:06.110349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:06.192454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:06.193843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:06.342711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 884/1764] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:06.352092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:06.352092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:06.352092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:06.417945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:06.426382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:06.463301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 881/1765] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:06.467545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:06.477999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced853f-1f2d-4da4-9113-a6e5d9c82303 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:06.493560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:06.494424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:06.494899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:06.495362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:06.496350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:06.496853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:06.498728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:06.528114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 885/1766] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:06.532689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:06.544717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3b221-c105-4b8c-8750-e3ee72333918 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:06.572779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:06.573709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:06.574133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:06.574479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:06.575350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:06.577677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:06.642380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 882/1767] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:06 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:06.645912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:06.658738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1d08f-fce4-47b6-be47-eec367cfcbca admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:06.807403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:06.808355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:06.808733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:06.813997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:06.814881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:06.816995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:06.856096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:06.863086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 886/1768] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:06 2022] POST /identity/v3/users => generated 282 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:06.868907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:06.892389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770aa73b-5ce7-4713-9c03-1ce56c8d3240 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:06.900327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:06.904884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:06.906502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:06.907320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:06.908947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:06.910700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:06.959630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 883/1769] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:06.963675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:06.978282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26f3cf-0103-442f-b8f1-e769bfb6d846 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:07.000621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34375-4779-4a7c-b728-5207ecd92dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:07.001486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34375-4779-4a7c-b728-5207ecd92dee admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:07.004104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34375-4779-4a7c-b728-5207ecd92dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:07.004505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34375-4779-4a7c-b728-5207ecd92dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:07.005391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34375-4779-4a7c-b728-5207ecd92dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:07.008286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34375-4779-4a7c-b728-5207ecd92dee admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:07.079558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 887/1770] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:07.081874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:07.102328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8b576-8c49-469a-af2c-f3c1bd02f75c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:07.122224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:07.123251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:07.123640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:07.128549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] PATH_INFO: `/v3/projects/e5242eea41d441c7b6808a14d841f2af/users/f20d71da734244aab31c1c2a322a61d4/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:07.164284 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5242eea41d441c7b6808a14d841f2af, user_id=f20d71da734244aab31c1c2a322a61d4, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:07.172794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:07.229088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 884/1771] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:07 2022] PUT /identity/v3/projects/e5242eea41d441c7b6808a14d841f2af/users/f20d71da734244aab31c1c2a322a61d4/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:07.233267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:07.233553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:07.233836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:07.314891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] MFA Rules not processed for user `f20d71da734244aab31c1c2a322a61d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:07.316400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:07.435963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 888/1772] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:07.440005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:07.480175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:07.544148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7fd9-104b-4df9-861a-cbf2782b36be admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:07.549282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:07.549963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:07.550248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:07.550540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:07.551229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:07.553180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:07.604680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 885/1773] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:07 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:07.606056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:07.628326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54404c-dc51-4836-bca8-9169f66c4551 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:07.802127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:07.802818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:07.803334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:07.803623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:07.804365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:07.806862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:07.846312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 889/1774] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:07 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:07.850184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:07.866615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7854ff3-ab84-4217-a15b-b8a05813ef08 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:07.884426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:07.886142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:07.891962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:07.892435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:07.907624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:07.923866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:07.971207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 886/1775] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:07.973560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:07.994730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78691856-acdd-4285-b399-70ba5d01fbda admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:08.013650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:08.014577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:08.014860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:08.015137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] PATH_INFO: `/v3/projects/ed167cf7fdaf424ab48481f002c266a8/users/5a5432ba04a049ad9afda9365d158d29/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:08.055213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed167cf7fdaf424ab48481f002c266a8, user_id=5a5432ba04a049ad9afda9365d158d29, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:08.059697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:08.126918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:08.127763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 890/1776] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:07 2022] PUT /identity/v3/projects/ed167cf7fdaf424ab48481f002c266a8/users/5a5432ba04a049ad9afda9365d158d29/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:08.144165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4c7ea-0caa-49a5-a52d-e7abddfd46e6 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:08.292558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:08.293258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:08.295442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:08.295756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:08.299852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:08.301557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:08.331744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 887/1777] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:08.333438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:08.367108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29892f-4219-45ea-b7dd-4e6dc8644fa7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:08.382934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511022-92f5-4cbf-80d8-b3a6e24f38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:08.386091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511022-92f5-4cbf-80d8-b3a6e24f38f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:08.387849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511022-92f5-4cbf-80d8-b3a6e24f38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:08.389732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511022-92f5-4cbf-80d8-b3a6e24f38f1 admin admin] PATH_INFO: `/v3/projects/ed167cf7fdaf424ab48481f002c266a8/users/5a5432ba04a049ad9afda9365d158d29/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:08.411216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad511022-92f5-4cbf-80d8-b3a6e24f38f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed167cf7fdaf424ab48481f002c266a8, user_id=5a5432ba04a049ad9afda9365d158d29, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:08.424483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad511022-92f5-4cbf-80d8-b3a6e24f38f1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:08.463138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:08.464897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:08.479155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 891/1778] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:08 2022] PUT /identity/v3/projects/ed167cf7fdaf424ab48481f002c266a8/users/5a5432ba04a049ad9afda9365d158d29/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:08.495425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:08.496374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:08.497148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b0b2-46e8-4d94-a902-e54ef8bf50ba admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:08.498445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:08.569099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] MFA Rules not processed for user `5a5432ba04a049ad9afda9365d158d29`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:08.571294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:08.599426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:08.690210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:08.692551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:08.693336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:08.695158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] PATH_INFO: `/v3/projects/d4d9c9a639b5480b856e26a81adb5b2b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:08.699289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d9c9a639b5480b856e26a81adb5b2b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:08.702089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:08.722367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 892/1779] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:08.737815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:08.748543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:08.818792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:08.846829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d9c9a639b5480b856e26a81adb5b2b', 'request_id': 'req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:08.867515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d9c9a639b5480b856e26a81adb5b2b', 'request_id': 'req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:08.886209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d9c9a639b5480b856e26a81adb5b2b', 'request_id': 'req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:08.887562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84234-b7c0-4756-b7c0-07e0409e1781 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:08.904121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] The token cache is being invalidate because project d4d9c9a639b5480b856e26a81adb5b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:08.904676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:08.905760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:08.909253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 888/1780] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:08 2022] DELETE /identity/v3/projects/d4d9c9a639b5480b856e26a81adb5b2b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:08.913511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:08.915370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:09.022130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:09.022334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:09.022607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:09.024174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:09.029415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:09.071261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c32f4-0e9a-4517-aa7f-22d8e10de296 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:09.086044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:09.087043 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:09.087409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:09.087581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] PATH_INFO: `/v3/users/f71eaa7f94e14b8f89911a7773c01ea0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:09.093718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71eaa7f94e14b8f89911a7773c01ea0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:09.095894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:09.221769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:09.223247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88104b94-d2e4-46b1-9e53-3b7049302a85 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:09.237907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71eaa7f94e14b8f89911a7773c01ea0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:09.265127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 893/1781] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:09.270341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:09.272316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:09.273695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:09.275343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71eaa7f94e14b8f89911a7773c01ea0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:09.278576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71eaa7f94e14b8f89911a7773c01ea0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:09.295853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71eaa7f94e14b8f89911a7773c01ea0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:09.313164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d105edc-00a8-4b89-ada9-86e6dc40378e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71eaa7f94e14b8f89911a7773c01ea0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:09.317065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] MFA Rules not processed for user `bf85b80a4bb747da9bd07454536380c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:09.322483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:09.327532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 889/1782] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:08 2022] DELETE /identity/v3/users/f71eaa7f94e14b8f89911a7773c01ea0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:09.331723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933787-45a2-4cb7-8bb4-e0fbaceebebc None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:09.332031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933787-45a2-4cb7-8bb4-e0fbaceebebc None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:09.332340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31933787-45a2-4cb7-8bb4-e0fbaceebebc None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:09.335285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 890/1783] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:59:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:59:09.358874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:09.425468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573420c2-0e68-4bad-b0e5-c330d2ce7025 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:09.425780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573420c2-0e68-4bad-b0e5-c330d2ce7025 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:09.426058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573420c2-0e68-4bad-b0e5-c330d2ce7025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:09.508588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-573420c2-0e68-4bad-b0e5-c330d2ce7025 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:09.517925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-573420c2-0e68-4bad-b0e5-c330d2ce7025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:09.535844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 894/1784] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:09.704085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:09.916852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 891/1785] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:59:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:10.449061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:10.450634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:10.658798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09153-9d69-4d5e-9f20-4e925fdcf2d3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:10.679479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:10.680547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:10.681829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:10.682215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] PATH_INFO: `/v3/users/f20d71da734244aab31c1c2a322a61d4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:10.689618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20d71da734244aab31c1c2a322a61d4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:10.691831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:10.844589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20d71da734244aab31c1c2a322a61d4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:10.870316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20d71da734244aab31c1c2a322a61d4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:10.882910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20d71da734244aab31c1c2a322a61d4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:10.926126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20d71da734244aab31c1c2a322a61d4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:10.927211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20d71da734244aab31c1c2a322a61d4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:10.942473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 895/1786] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:10 2022] DELETE /identity/v3/users/f20d71da734244aab31c1c2a322a61d4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:10.947642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7952886-947b-4de2-856f-5f48981530fb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:10.948175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7952886-947b-4de2-856f-5f48981530fb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:10.948282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7952886-947b-4de2-856f-5f48981530fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:10.993063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a7952886-947b-4de2-856f-5f48981530fb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:10.994319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a7952886-947b-4de2-856f-5f48981530fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:11.040366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:11.041939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:11.179457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:11.209959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 892/1787] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:11.240524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7952886-947b-4de2-856f-5f48981530fb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:11.241953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a7952886-947b-4de2-856f-5f48981530fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:11.269073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c315b-e560-40ab-9699-ac370cf2994e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:11.280733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:11.281495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:11.281868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:11.282212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:11.300195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:11.336223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:11.338044 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:11.382295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 896/1788] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:11.390274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7952886-947b-4de2-856f-5f48981530fb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:11.395363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf91127-2cc9-49fa-8da2-ee41c27c44ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:11.396416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91127-2cc9-49fa-8da2-ee41c27c44ac service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:11.400531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91127-2cc9-49fa-8da2-ee41c27c44ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:11.401253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf91127-2cc9-49fa-8da2-ee41c27c44ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:11.421632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91127-2cc9-49fa-8da2-ee41c27c44ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:11.423297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf91127-2cc9-49fa-8da2-ee41c27c44ac service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:11.467520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 893/1789] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:11.575842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:11.578037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:11.601147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9329cb0f-0a7e-4bf3-825d-10505723e390 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:11.614409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:11.615300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:11.615566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:11.615840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] PATH_INFO: `/v3/projects/c8315348aa064358ae77fa3b00c1ebbd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:11.617819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8315348aa064358ae77fa3b00c1ebbd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:11.630962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:11.793194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8315348aa064358ae77fa3b00c1ebbd', 'request_id': 'req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:11.802984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8315348aa064358ae77fa3b00c1ebbd', 'request_id': 'req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:11.831263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8315348aa064358ae77fa3b00c1ebbd', 'request_id': 'req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:11.863808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] The token cache is being invalidate because project c8315348aa064358ae77fa3b00c1ebbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:11.864335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:11.864897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0c7740ee-acf0-4f90-a140-c80d5d1ed82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:11.884609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 897/1790] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:11 2022] DELETE /identity/v3/projects/c8315348aa064358ae77fa3b00c1ebbd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:11.885912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:11.886347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:11.887787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:11.933409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:11.933409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:12.127297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 894/1791] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:12.135610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.135908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.136208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.184698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:12.188278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:12.213541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 898/1792] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:12.218733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.242159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4958-306b-4c94-9347-82796055fb87 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.252818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:12.253513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.253793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.254065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.254805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:12.257108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:12.259648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:12.297945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 895/1793] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:12.302943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.321996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52786-996e-4108-b838-5ab3ffc9a891 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.342840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:12.344809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.345112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.345486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.350008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:12.356351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:12.432565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 899/1794] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:12 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:12.435143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.441453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:12.456588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d962-c5d3-44ce-a156-f95cdc9faeaf admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.632696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:12.634965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.640211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.640900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.642744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:12.645213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:12.701429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 896/1795] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:12 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:12.702656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.720146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932de7-9410-4458-887c-d794dd3adba8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.729329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:12.731095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.731388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.731671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.733511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:12.739359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:12.782521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 900/1796] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:12.786814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.800931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418308-320d-424f-ab86-e73e08690dd4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.806496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:12.807232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.807521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.807851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.808636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:12.810339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:12.823724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 897/1797] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:12.827613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.840538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5a033-0d95-4440-84cc-a0e1d0dd007e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.845710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053b11-3c16-48ba-a0c0-11776e4aa871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:12.846932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053b11-3c16-48ba-a0c0-11776e4aa871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.847215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053b11-3c16-48ba-a0c0-11776e4aa871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.847489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053b11-3c16-48ba-a0c0-11776e4aa871 admin admin] PATH_INFO: `/v3/projects/ee73a2c3defe434aa41a6d61c031e2c9/users/25e62226452b42e5b7542dac51f9fb6f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.864141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053b11-3c16-48ba-a0c0-11776e4aa871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee73a2c3defe434aa41a6d61c031e2c9, user_id=25e62226452b42e5b7542dac51f9fb6f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:12.866806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053b11-3c16-48ba-a0c0-11776e4aa871 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:12.881543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 901/1798] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:12 2022] PUT /identity/v3/projects/ee73a2c3defe434aa41a6d61c031e2c9/users/25e62226452b42e5b7542dac51f9fb6f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:12.882742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:12.885840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:12.892740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:12.903707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:12.904018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:12.917424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79021756-afb5-4154-abb5-73fae8c3dced admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:12.968241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] MFA Rules not processed for user `25e62226452b42e5b7542dac51f9fb6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:12.969677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:13.009440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.010329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.010608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.010881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] PATH_INFO: `/v3/projects/e5242eea41d441c7b6808a14d841f2af` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.012916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5242eea41d441c7b6808a14d841f2af)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.015732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.060573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:13.122694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 902/1799] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:13.124947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.125826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5242eea41d441c7b6808a14d841f2af', 'request_id': 'req-adacd5f4-189c-40cd-8a2a-064e4188114a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.139925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641d439-317d-4acd-9ab6-3826920c0fda None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:13.148168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5242eea41d441c7b6808a14d841f2af', 'request_id': 'req-adacd5f4-189c-40cd-8a2a-064e4188114a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.165130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5242eea41d441c7b6808a14d841f2af', 'request_id': 'req-adacd5f4-189c-40cd-8a2a-064e4188114a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.187022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] The token cache is being invalidate because project e5242eea41d441c7b6808a14d841f2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:13.187947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.189299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.192096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 898/1800] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:12 2022] DELETE /identity/v3/projects/e5242eea41d441c7b6808a14d841f2af => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:13.198845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.205130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:13.226634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:13.285406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.286102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.286797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.287090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.287837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.296621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.351039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacd5f4-189c-40cd-8a2a-064e4188114a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:13.368026 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.369810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.371687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.372167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] PATH_INFO: `/v3/users/5a5432ba04a049ad9afda9365d158d29` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.374200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5432ba04a049ad9afda9365d158d29)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.380535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.404503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 903/1801] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:13 2022] POST /identity/v3/projects => generated 387 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:13.411841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.414221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:13.534627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5432ba04a049ad9afda9365d158d29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.558841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5432ba04a049ad9afda9365d158d29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.559836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5432ba04a049ad9afda9365d158d29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.568303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5432ba04a049ad9afda9365d158d29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.577699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469f369-e7e0-4bd9-be36-625e0466647f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:13.592433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5432ba04a049ad9afda9365d158d29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:13.593181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.594584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.594584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.594584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.604765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.605690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 899/1802] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:13 2022] DELETE /identity/v3/users/5a5432ba04a049ad9afda9365d158d29 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:13.606692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.639694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 904/1803] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:13 2022] POST /identity/v3/users => generated 300 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:13.643673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.645890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:13.750381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf24f52-eec1-4e38-a915-1506ea9541ff admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:13.757308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.758611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.760080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.760812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.761934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.763883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.784422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 900/1804] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:13.789670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.807636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2763c-71ab-424d-81f6-5207b3759c2f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:13.811556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.812713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.813222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.813704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] PATH_INFO: `/v3/projects/c30fac9a30ae4c1dbfa25467db4f6c78/users/da6e5c6a39fa43c892d9ef06af827451/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.833074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30fac9a30ae4c1dbfa25467db4f6c78, user_id=da6e5c6a39fa43c892d9ef06af827451, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.836725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.861742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 905/1805] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:13 2022] PUT /identity/v3/projects/c30fac9a30ae4c1dbfa25467db4f6c78/users/da6e5c6a39fa43c892d9ef06af827451/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:13.863601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.885227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d1674-03dc-4edd-a6f9-0d533b845e84 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:13.924893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:13.983060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:13.983900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:13.984228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:13.984553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:13.985853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:13.988102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:13.989056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:13.989821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.004035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 901/1806] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:14.008521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.013386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05c53f-b5cd-4f76-bee8-42f529175b7a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.025223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.026841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17f018-6148-4af1-a4e4-0ef481234743 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.032075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877eb22d-909b-4407-b7f1-2c73e05151f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.033123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb22d-909b-4407-b7f1-2c73e05151f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.033501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb22d-909b-4407-b7f1-2c73e05151f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.034025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877eb22d-909b-4407-b7f1-2c73e05151f9 admin admin] PATH_INFO: `/v3/projects/c30fac9a30ae4c1dbfa25467db4f6c78/users/da6e5c6a39fa43c892d9ef06af827451/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.036244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eb22d-909b-4407-b7f1-2c73e05151f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30fac9a30ae4c1dbfa25467db4f6c78, user_id=da6e5c6a39fa43c892d9ef06af827451, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.037058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.037899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.038365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] PATH_INFO: `/v3/projects/ed167cf7fdaf424ab48481f002c266a8` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.039401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877eb22d-909b-4407-b7f1-2c73e05151f9 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.041017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed167cf7fdaf424ab48481f002c266a8)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.043491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.055401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 902/1807] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:14 2022] PUT /identity/v3/projects/c30fac9a30ae4c1dbfa25467db4f6c78/users/da6e5c6a39fa43c892d9ef06af827451/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:14.068726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.069128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.069651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.103133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:14.111053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] MFA Rules not processed for user `da6e5c6a39fa43c892d9ef06af827451`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:14.113124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.129989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed167cf7fdaf424ab48481f002c266a8', 'request_id': 'req-bee92618-779e-46cc-85cc-c277bf8c3798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.139246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed167cf7fdaf424ab48481f002c266a8', 'request_id': 'req-bee92618-779e-46cc-85cc-c277bf8c3798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.156166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed167cf7fdaf424ab48481f002c266a8', 'request_id': 'req-bee92618-779e-46cc-85cc-c277bf8c3798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.180419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] The token cache is being invalidate because project ed167cf7fdaf424ab48481f002c266a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:14.180839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.181675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee92618-779e-46cc-85cc-c277bf8c3798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.183286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 906/1808] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:13 2022] DELETE /identity/v3/projects/ed167cf7fdaf424ab48481f002c266a8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:14.188143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08874a-a8d7-4aea-b4ef-93e373f5d2cc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.188552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08874a-a8d7-4aea-b4ef-93e373f5d2cc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.188900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08874a-a8d7-4aea-b4ef-93e373f5d2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.204563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 903/1809] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:14.215238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0a08874a-a8d7-4aea-b4ef-93e373f5d2cc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:14.216486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a08874a-a8d7-4aea-b4ef-93e373f5d2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.217339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.218777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.309685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 907/1810] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:14.311442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.311834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.312259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.328496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a875e-54dc-436a-8fc2-64537e067d02 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.335775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.337354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.337787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.338228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.349140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:14.350544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.363064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.365066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.380056 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 908/1811] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:14.382344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.384895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 904/1812] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:14.393390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f1f49-0aa6-4d79-98cf-f95b182ee0db None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.399144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.399860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.400190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.400467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.401307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:14.412161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.413848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.433294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.434863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.447070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 909/1813] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:14.451179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.454094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676088-6a6f-4cfd-b294-77566617fdb7 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.458936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.459921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.460310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.460812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] PATH_INFO: `/v3/users/25e62226452b42e5b7542dac51f9fb6f` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.463342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e62226452b42e5b7542dac51f9fb6f)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.465120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2e83-ae51-491d-8605-93925b256ba6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.465598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.470495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.471215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.471444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.471723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.472590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.474567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.507319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 910/1814] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:14.512027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.519929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:14.536848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e62226452b42e5b7542dac51f9fb6f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.550829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e62226452b42e5b7542dac51f9fb6f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.551588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e62226452b42e5b7542dac51f9fb6f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.561837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e62226452b42e5b7542dac51f9fb6f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.570347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15e6b89f-b038-49e3-a36d-e8f55df2f408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e62226452b42e5b7542dac51f9fb6f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:14.580745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 905/1815] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:14 2022] DELETE /identity/v3/users/25e62226452b42e5b7542dac51f9fb6f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:14.582222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.582582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.582930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.589476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e13487-bb6e-4b6c-98e3-e9529c4345b4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.606071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:14.607633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.617034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:14.667900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.668708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.669053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.669398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.670160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.674630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.696357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 911/1816] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:14.700986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.702842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.708386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 906/1817] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:14.721003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce81fd-f449-4a56-b491-3e1bbfa0fafb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.721670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.723337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.726630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.727401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.728285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.728649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.729479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.731202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.741718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 912/1818] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:14.746146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.755778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9efd8-f125-4d89-b61b-f631046aa9c6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.760714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.761352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.761637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.761916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.762629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.764234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.777343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 913/1819] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:14.778168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:14.782538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78bcf0-b9c4-4058-b5bf-7b08ef1fc56d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.786168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b34ca7-15ff-48aa-88d0-8cb7c49a24c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.786812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34ca7-15ff-48aa-88d0-8cb7c49a24c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.787094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34ca7-15ff-48aa-88d0-8cb7c49a24c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.787369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b34ca7-15ff-48aa-88d0-8cb7c49a24c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.787569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499606cc-0284-4e0b-9f84-8b90e5efd143 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:14.792670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:14.793532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.793817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.794095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] PATH_INFO: `/v3/projects/f84ea43f6ae74d82a8c79101fc8dc468/users/a1787f50e2e94735b7035f38d4165f87/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.797065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b34ca7-15ff-48aa-88d0-8cb7c49a24c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.798491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b34ca7-15ff-48aa-88d0-8cb7c49a24c5 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.808573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 907/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:14.809686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84ea43f6ae74d82a8c79101fc8dc468, user_id=a1787f50e2e94735b7035f38d4165f87, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:14.812510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:14.826082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 914/1821] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:14 2022] PUT /identity/v3/projects/f84ea43f6ae74d82a8c79101fc8dc468/users/a1787f50e2e94735b7035f38d4165f87/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:14.837365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:14.837737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:14.838018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:14.866836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] MFA Rules not processed for user `a1787f50e2e94735b7035f38d4165f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:14.868076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:14.911755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:14.937127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 908/1822] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:14.941578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.010331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91df61-0f04-4b84-ab63-d6953052a27a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.015062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.015716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.016027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.016306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.017003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.018891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.048100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 915/1823] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:14 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:15.049245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.060295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2087bc5-c872-4951-82d3-47b4d612a428 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.084416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.092073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:15.140237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.141027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.141384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.141672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.142356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.144378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.148998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:15.165976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 909/1824] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:15 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:15.169827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.170136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5fc23-6ebe-442f-84c6-2f1e889791ae admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.175015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.175885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.176199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.176478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] PATH_INFO: `/v3/projects/ee73a2c3defe434aa41a6d61c031e2c9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.177694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee73a2c3defe434aa41a6d61c031e2c9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.179611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.179716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abf42b-a07b-4878-a99d-45723d1ecacf admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.184463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.185099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.185379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.185648 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.186364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.187957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.198085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 910/1825] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:15.201846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.211671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c2340-8a8d-47f4-8e58-977e8642366a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.217189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.218055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.218334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.218619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] PATH_INFO: `/v3/projects/e3aead1b09514944bc121f326c548e15/users/2f4aebd1354b49f7b992db823fa201b7/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.227192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee73a2c3defe434aa41a6d61c031e2c9', 'request_id': 'req-3123afdb-2cc7-49ab-8faa-87f0edaddb40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.233543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aead1b09514944bc121f326c548e15, user_id=2f4aebd1354b49f7b992db823fa201b7, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.234497 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee73a2c3defe434aa41a6d61c031e2c9', 'request_id': 'req-3123afdb-2cc7-49ab-8faa-87f0edaddb40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.236471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.243209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee73a2c3defe434aa41a6d61c031e2c9', 'request_id': 'req-3123afdb-2cc7-49ab-8faa-87f0edaddb40'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.250462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 911/1826] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:15 2022] PUT /identity/v3/projects/e3aead1b09514944bc121f326c548e15/users/2f4aebd1354b49f7b992db823fa201b7/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:15.253535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] The token cache is being invalidate because project ee73a2c3defe434aa41a6d61c031e2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:15.253828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.254261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.254465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.256022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 916/1827] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:15 2022] DELETE /identity/v3/projects/ee73a2c3defe434aa41a6d61c031e2c9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:15.259666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.261393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:15.355848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb988c9-a926-4c02-9190-80e7f357059f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.361583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.362274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.362553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.362826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.363566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.365976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.369501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123afdb-2cc7-49ab-8faa-87f0edaddb40 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.377872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 912/1828] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:15.383616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.383616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.384431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.384623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] PATH_INFO: `/v3/users/da6e5c6a39fa43c892d9ef06af827451` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.385539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.385865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6e5c6a39fa43c892d9ef06af827451)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.387524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:15.387795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.409441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6575633-47b5-4998-b84c-aca79b3cf998 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.427465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67166a9-5a82-4ad6-b666-33740d1205a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.428679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67166a9-5a82-4ad6-b666-33740d1205a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.429399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67166a9-5a82-4ad6-b666-33740d1205a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.429399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67166a9-5a82-4ad6-b666-33740d1205a3 admin admin] PATH_INFO: `/v3/projects/e3aead1b09514944bc121f326c548e15/users/2f4aebd1354b49f7b992db823fa201b7/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.432098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67166a9-5a82-4ad6-b666-33740d1205a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aead1b09514944bc121f326c548e15, user_id=2f4aebd1354b49f7b992db823fa201b7, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.435630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67166a9-5a82-4ad6-b666-33740d1205a3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.459000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 913/1829] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:15 2022] PUT /identity/v3/projects/e3aead1b09514944bc121f326c548e15/users/2f4aebd1354b49f7b992db823fa201b7/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:15.469855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.470198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.470550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.485258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6e5c6a39fa43c892d9ef06af827451'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.507597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6e5c6a39fa43c892d9ef06af827451'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.522781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6e5c6a39fa43c892d9ef06af827451'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.531396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6e5c6a39fa43c892d9ef06af827451'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.532452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6e5c6a39fa43c892d9ef06af827451'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:15.534239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:15.545990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 917/1830] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:15 2022] DELETE /identity/v3/users/da6e5c6a39fa43c892d9ef06af827451 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:15.546909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] MFA Rules not processed for user `2f4aebd1354b49f7b992db823fa201b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:15.548298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:15.567884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:15.661374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 914/1831] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:15 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:15.679376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:15.682336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:15.771413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37abff-4a92-4418-b275-ebf390b2fb35 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:15.775904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39573-1388-451d-8a22-f7823bf1c36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:15.776668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39573-1388-451d-8a22-f7823bf1c36c service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:15.777022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39573-1388-451d-8a22-f7823bf1c36c service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:15.777374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39573-1388-451d-8a22-f7823bf1c36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:15.790603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39573-1388-451d-8a22-f7823bf1c36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:15.793758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39573-1388-451d-8a22-f7823bf1c36c service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:15.819786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 918/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:16.113003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:16.117116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:16.246508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34e28e-80c5-4b9d-81b9-a3a18632de34 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:16.251297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:16.252223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.252510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.252793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] PATH_INFO: `/v3/projects/c30fac9a30ae4c1dbfa25467db4f6c78` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.254019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30fac9a30ae4c1dbfa25467db4f6c78)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:16.256260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:16.313170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30fac9a30ae4c1dbfa25467db4f6c78', 'request_id': 'req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:16.320851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30fac9a30ae4c1dbfa25467db4f6c78', 'request_id': 'req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:16.331087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30fac9a30ae4c1dbfa25467db4f6c78', 'request_id': 'req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:16.344800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] The token cache is being invalidate because project c30fac9a30ae4c1dbfa25467db4f6c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:16.345092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:16.345778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-37cf9ceb-ebf0-4a8f-a2ca-36602e274849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:16.351263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 915/1833] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:16 2022] DELETE /identity/v3/projects/c30fac9a30ae4c1dbfa25467db4f6c78 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:16.353124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.353643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.353936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.388631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:16.389937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:16.494794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 919/1834] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:16.503155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.503440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.503730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.544450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:16.545670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:16.562779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 916/1835] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:16.567119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:16.580747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff89d3-37df-4c01-ac41-34a7feef22c0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:16.586560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:16.587682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.595962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.596474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.597354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:16.597820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:16.599545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:16.625247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 920/1836] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:16.627111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:16.641272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e4ae1-6da7-4665-a8d7-104f0d54fe5d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:16.647770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:16.648925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.650639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.651077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.651778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:16.653927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:16.711615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:16.728329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 917/1837] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:16 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:16.736764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf619a-67b4-4481-b6be-523f6cd865cf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:16.904381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:16.905368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.905833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.906296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.907864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:16.910305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:16.944250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 921/1838] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:16 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:16.948639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:16.965304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc15c3-3076-4e79-b765-37471d108275 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:16.971427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:16.972516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:16.972955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:16.974254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:16.975159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:16.977147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:16.979592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:17.008490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 918/1839] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:17.012784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:17.053880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459e883-5aeb-4adb-a3e7-de5fb4665361 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:17.061522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ed38a-baab-49b2-8e96-f7223aa82a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:17.062440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed38a-baab-49b2-8e96-f7223aa82a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:17.062832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed38a-baab-49b2-8e96-f7223aa82a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:17.063208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed38a-baab-49b2-8e96-f7223aa82a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:17.064113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ed38a-baab-49b2-8e96-f7223aa82a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:17.075307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ed38a-baab-49b2-8e96-f7223aa82a8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:17.089577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 922/1840] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:17.093624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:17.122980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd14fa-eda6-4341-9745-dab5398c7159 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:17.136374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:17.137282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:17.137567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:17.137834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] PATH_INFO: `/v3/projects/7c2ed808b495465bb0c0040992970e38/users/e1a2b10d415f4884b6d91d4c411e1689/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:17.154299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2ed808b495465bb0c0040992970e38, user_id=e1a2b10d415f4884b6d91d4c411e1689, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:17.163680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:17.199142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 919/1841] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:17 2022] PUT /identity/v3/projects/7c2ed808b495465bb0c0040992970e38/users/e1a2b10d415f4884b6d91d4c411e1689/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:17.209328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:17.209670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:17.209981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:17.238317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:17.277933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] MFA Rules not processed for user `e1a2b10d415f4884b6d91d4c411e1689`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:17.279183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:17.421183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 923/1842] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:17.426035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:17.574099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dc221-d3d7-491f-a166-5c6f4f636cff admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:17.579913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:17.586637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:17.586637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:17.586637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:17.586637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:17.586637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:17.626447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 920/1843] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:17 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:17.627760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:17.648444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e43f22-a145-49e0-bf96-c2a54b15c550 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:17.788748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:17.789937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:17.790414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:17.790833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:17.791706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:17.801822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:17.859019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:17.861341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 924/1844] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:17 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:17.885982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa277d7-e7fe-4195-8ff8-cde394974776 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:17.928338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:17.929737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:17.931685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:17.932243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:17.934964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:17.938493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:17.968232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 921/1845] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:17.973542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:17.997867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a3469-b005-4833-a875-4daf26aa4ce0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:18.009336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:18.011149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.012064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.012744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] PATH_INFO: `/v3/projects/52faa65efd7941fd9f6977286695bfca/users/eb309562c8bb46e4b96c7ac0401f8655/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:18.043439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52faa65efd7941fd9f6977286695bfca, user_id=eb309562c8bb46e4b96c7ac0401f8655, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:18.049941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:18.052143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:18.077551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:18.104007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfffa6-7c0a-4720-98c6-bc4e8a501d8e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:18.117830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:18.120430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.120717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.120996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] PATH_INFO: `/v3/users/a1787f50e2e94735b7035f38d4165f87` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:18.121784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 925/1846] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:17 2022] PUT /identity/v3/projects/52faa65efd7941fd9f6977286695bfca/users/eb309562c8bb46e4b96c7ac0401f8655/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:18.122520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1787f50e2e94735b7035f38d4165f87)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:18.124669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:18.126156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:18.312177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1787f50e2e94735b7035f38d4165f87'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:18.345422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1787f50e2e94735b7035f38d4165f87'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:18.349233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1787f50e2e94735b7035f38d4165f87'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:18.360637 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1787f50e2e94735b7035f38d4165f87'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:18.362307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc42b37-588c-4a59-b485-6befbdb0f4a1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:18.376724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:18.377418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.377707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.377985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:18.378723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:18.380349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:18.393050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7d52a253-e637-412e-a65c-fb7b086da217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1787f50e2e94735b7035f38d4165f87'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:18.393369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:18.407956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 922/1847] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:18 2022] DELETE /identity/v3/users/a1787f50e2e94735b7035f38d4165f87 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:18.413461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 926/1848] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:18.416890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:18.417647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.418349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.418945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:18.421368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:18.453502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:18.454076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30f7fa-5566-4d98-86ef-af65aba18eb3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:18.455458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:18.505967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:18.637190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7774d9d-d64a-4b1a-ac3a-015cb2e8ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:18.642416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774d9d-d64a-4b1a-ac3a-015cb2e8ea34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.643570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774d9d-d64a-4b1a-ac3a-015cb2e8ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.645240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7774d9d-d64a-4b1a-ac3a-015cb2e8ea34 admin admin] PATH_INFO: `/v3/projects/52faa65efd7941fd9f6977286695bfca/users/eb309562c8bb46e4b96c7ac0401f8655/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:18.673470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7774d9d-d64a-4b1a-ac3a-015cb2e8ea34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52faa65efd7941fd9f6977286695bfca, user_id=eb309562c8bb46e4b96c7ac0401f8655, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:18.694745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 923/1849] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:18.695930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7774d9d-d64a-4b1a-ac3a-015cb2e8ea34 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:18.741995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 927/1850] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:18 2022] PUT /identity/v3/projects/52faa65efd7941fd9f6977286695bfca/users/eb309562c8bb46e4b96c7ac0401f8655/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:18.748223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:18.751929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.752402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:18.753944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.754257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:18.815069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] MFA Rules not processed for user `eb309562c8bb46e4b96c7ac0401f8655`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:18.816515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:18.858038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a06238-0f36-4576-a7bd-af17ec8051fb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:18.918521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 928/1851] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:18.929498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:18.933035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:18.944033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8220f-0065-4f62-8468-a0e3deda2139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:18.945035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8220f-0065-4f62-8468-a0e3deda2139 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:18.945532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8220f-0065-4f62-8468-a0e3deda2139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:18.945811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8220f-0065-4f62-8468-a0e3deda2139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:19.031930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66dd5-ae4e-4f0c-a779-915488d0992b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:19.037541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:19.038753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:19.039197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:19.039611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:19.051822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8220f-0065-4f62-8468-a0e3deda2139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:19.053665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:19.053851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8220f-0065-4f62-8468-a0e3deda2139 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:19.055204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:19.067048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 929/1852] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:19.070400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 924/1853] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:19.805195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:19.818677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae5878-af1e-41f9-aa85-3c09e19bd6b4 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:19.824558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:19.825454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:19.825735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:19.826009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] PATH_INFO: `/v3/users/e1a2b10d415f4884b6d91d4c411e1689` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:19.827397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a2b10d415f4884b6d91d4c411e1689)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:19.829408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:19.856244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:19.936941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a2b10d415f4884b6d91d4c411e1689'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:19.951804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a2b10d415f4884b6d91d4c411e1689'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:19.963467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a2b10d415f4884b6d91d4c411e1689'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:19.980262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a2b10d415f4884b6d91d4c411e1689'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:19.981304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a2b10d415f4884b6d91d4c411e1689'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:19.990239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 930/1854] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:19 2022] DELETE /identity/v3/users/e1a2b10d415f4884b6d91d4c411e1689 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:19.995762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:19.996790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:19.997420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:20.035922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:20.038866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:20.077183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:20.151628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 925/1855] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:20.163589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:20.166638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:20.266985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfa2b3-026c-47eb-ba81-2aed4af25a04 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:20.270977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:20.271724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:20.272024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:20.272544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:20.284581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:20.287670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:20.303268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 931/1856] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:20.363596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:20.366243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:20.416854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3ac94-91d4-4213-8b14-2ec049bb804e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:20.428315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:20.432686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:20.434088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:20.434711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] PATH_INFO: `/v3/projects/f84ea43f6ae74d82a8c79101fc8dc468` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:20.436682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84ea43f6ae74d82a8c79101fc8dc468)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:20.440531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:20.500201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84ea43f6ae74d82a8c79101fc8dc468', 'request_id': 'req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.507210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84ea43f6ae74d82a8c79101fc8dc468', 'request_id': 'req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.518342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84ea43f6ae74d82a8c79101fc8dc468', 'request_id': 'req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.534457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] The token cache is being invalidate because project f84ea43f6ae74d82a8c79101fc8dc468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:20.534752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.535409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.537033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 926/1857] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:20 2022] DELETE /identity/v3/projects/f84ea43f6ae74d82a8c79101fc8dc468 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:20.540967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:20.551147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478429-b1a4-43d4-8dd3-ed4801d5d38b service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:20.615626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:20.616653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:20.617007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:20.617360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] PATH_INFO: `/v3/users/2f4aebd1354b49f7b992db823fa201b7` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:20.619188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4aebd1354b49f7b992db823fa201b7)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:20.621228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:20.668200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:20.679029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4aebd1354b49f7b992db823fa201b7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.695448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4aebd1354b49f7b992db823fa201b7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.704062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4aebd1354b49f7b992db823fa201b7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.711305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4aebd1354b49f7b992db823fa201b7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.712300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4aebd1354b49f7b992db823fa201b7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:20.719365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 932/1858] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:20 2022] DELETE /identity/v3/users/2f4aebd1354b49f7b992db823fa201b7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:21.133745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:21.135167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:21.159369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e9fc-49ec-4c73-9d53-b0a7aa72c623 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:21.221793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:21.224367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:21.392898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:21.393719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:21.394006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:21.394283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] PATH_INFO: `/v3/projects/e3aead1b09514944bc121f326c548e15` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:21.395668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3aead1b09514944bc121f326c548e15)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:21.397651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:21.409076 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8ed9e-ee3b-4103-8682-2b3d254831f4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:21.424850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:21.426161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:21.426665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:21.427147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] PATH_INFO: `/v3/users/4a23f19c51da4c378cca4eba7a28a4b3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:21.430978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a23f19c51da4c378cca4eba7a28a4b3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:21.436693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:21.516517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a23f19c51da4c378cca4eba7a28a4b3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.524442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3aead1b09514944bc121f326c548e15', 'request_id': 'req-c0756812-7222-40b9-8218-083bb8c0159a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.529959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:21.539119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a23f19c51da4c378cca4eba7a28a4b3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.542427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3aead1b09514944bc121f326c548e15', 'request_id': 'req-c0756812-7222-40b9-8218-083bb8c0159a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.562074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3aead1b09514944bc121f326c548e15', 'request_id': 'req-c0756812-7222-40b9-8218-083bb8c0159a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.572610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a23f19c51da4c378cca4eba7a28a4b3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.580335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] The token cache is being invalidate because project e3aead1b09514944bc121f326c548e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:21.581466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.581999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.589480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 927/1859] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:21 2022] DELETE /identity/v3/projects/e3aead1b09514944bc121f326c548e15 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:21.589480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:21.591816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:21.595828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a23f19c51da4c378cca4eba7a28a4b3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.596476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5831132d-7fd7-42ea-96d7-9d67e0a8ce0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a23f19c51da4c378cca4eba7a28a4b3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.619341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 933/1860] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:21 2022] DELETE /identity/v3/users/4a23f19c51da4c378cca4eba7a28a4b3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:21.623617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457d0a-3dcd-4adc-b9ec-c32a53bd2a88 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:21.623958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457d0a-3dcd-4adc-b9ec-c32a53bd2a88 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:21.624698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d457d0a-3dcd-4adc-b9ec-c32a53bd2a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:21.705934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9d457d0a-3dcd-4adc-b9ec-c32a53bd2a88 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:21.707945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9d457d0a-3dcd-4adc-b9ec-c32a53bd2a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:21.783932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756812-7222-40b9-8218-083bb8c0159a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:21.844439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:21.865646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:21.866734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:21.867024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:21.867337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] PATH_INFO: `/v3/projects/7c2ed808b495465bb0c0040992970e38` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:21.869453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2ed808b495465bb0c0040992970e38)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:21.871606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:21.904292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 934/1861] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:21.905766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:21.906072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:21.906368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:21.935401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:21.936594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:21.964927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2ed808b495465bb0c0040992970e38', 'request_id': 'req-792553bd-f38e-42b9-bc7b-102fc2a1e96c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:21.980480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2ed808b495465bb0c0040992970e38', 'request_id': 'req-792553bd-f38e-42b9-bc7b-102fc2a1e96c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.000869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2ed808b495465bb0c0040992970e38', 'request_id': 'req-792553bd-f38e-42b9-bc7b-102fc2a1e96c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.023111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] The token cache is being invalidate because project 7c2ed808b495465bb0c0040992970e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:22.023458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.026167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-792553bd-f38e-42b9-bc7b-102fc2a1e96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.028819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 928/1862] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:21 2022] DELETE /identity/v3/projects/7c2ed808b495465bb0c0040992970e38 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:22.030087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.030375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.030656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.046878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 935/1863] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:22.047852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.049293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:22.065264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350a4ec-95cb-409b-b49a-320e114e442a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.070661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.072861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.073695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.073989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] PATH_INFO: `/v3/users/eb309562c8bb46e4b96c7ac0401f8655` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.075273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb309562c8bb46e4b96c7ac0401f8655)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.077497 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.080229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:22.081737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:22.114301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 929/1864] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:22.115185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.120554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:22.145868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:22.174110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb309562c8bb46e4b96c7ac0401f8655'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.193136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb309562c8bb46e4b96c7ac0401f8655'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.204194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb309562c8bb46e4b96c7ac0401f8655'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.214581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec858a-fffa-4fca-b2ce-a2a9870dd113 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.215880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb309562c8bb46e4b96c7ac0401f8655'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.217027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb309562c8bb46e4b96c7ac0401f8655'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:22.218700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.219385 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.219672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.219951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.221869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:22.237385 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.238851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.245471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 936/1865] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:22 2022] DELETE /identity/v3/users/eb309562c8bb46e4b96c7ac0401f8655 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:22.251262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.251479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 930/1866] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:22.255546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:22.325018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:22.345676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a2fae-baea-4c08-9e6f-417f9e96ccb1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.353162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.354670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.354955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.355371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.356152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:22.356467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.358390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.373310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 937/1867] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:22.377895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.390131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36af96b-e57b-4387-a3aa-4430b59db1d3 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.395504 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.397143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.397624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.398096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.399113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.401322 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.461019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 931/1868] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:22 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:22.461998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.475850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a558-561e-44a9-b0fa-b124043b1571 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.576550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.577870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.579031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.579508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.580949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.583952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.615134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 938/1869] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:22 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:22.619412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.631816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd11375-1823-4f4f-838a-98dede9d8e01 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.637598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.638379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.638737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.639089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.639914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.641922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.658717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 932/1870] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:22.660138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.682604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afe3a-a271-4edf-bdc2-f50a91b96030 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.691383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd53896-287b-489d-b7a8-a9124a8ca54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.692168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd53896-287b-489d-b7a8-a9124a8ca54c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.693296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd53896-287b-489d-b7a8-a9124a8ca54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.693778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd53896-287b-489d-b7a8-a9124a8ca54c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.694877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd53896-287b-489d-b7a8-a9124a8ca54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.696966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd53896-287b-489d-b7a8-a9124a8ca54c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.718666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 939/1871] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:22.721639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:22.739020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9a86-2dd2-4515-ad20-3910be59917a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:22.749499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:22.751264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.751729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.752500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] PATH_INFO: `/v3/projects/1e607c0de24a404fb4429af40634b7b0/users/1a3f1bd3946141359e0ef5064588f947/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.776875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e607c0de24a404fb4429af40634b7b0, user_id=1a3f1bd3946141359e0ef5064588f947, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:22.780833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:22.811968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 933/1872] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:22 2022] PUT /identity/v3/projects/1e607c0de24a404fb4429af40634b7b0/users/1a3f1bd3946141359e0ef5064588f947/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:22.823214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:22.823618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:22.824132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:22.858050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] MFA Rules not processed for user `1a3f1bd3946141359e0ef5064588f947`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:22.860052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:22.972790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 940/1873] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:22.977817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.080194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc990597-54d1-4a73-98f1-c40ff6b9a371 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:23.085177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:23.085852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.086139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.086421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.087697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:23.089782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:23.122919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 934/1874] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:22 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:23.127188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.139233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f303ac-3a6b-4395-b1c4-ac6b058c568a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:23.192904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:23.213855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:23.215298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.215298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.215298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.216020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:23.218824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:23.251222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 941/1875] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:23 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:23.255295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.271638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788e6e5-7a30-458d-8878-79de30cbcd88 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:23.277885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:23.278670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.280018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.280367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.281765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:23.283690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:23.323540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.325681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 935/1876] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:23.345348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831b4f4-e1ac-4b46-adef-e8af509d67b6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:23.352363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:23.360586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.361206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.361739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] PATH_INFO: `/v3/projects/b86f72bea9ec47728ed76ffda0e8ddd7/users/e1511d477ce040fabeef91166dc509c9/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.444594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86f72bea9ec47728ed76ffda0e8ddd7, user_id=e1511d477ce040fabeef91166dc509c9, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:23.447411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:23.496119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.496988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 942/1877] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:23 2022] PUT /identity/v3/projects/b86f72bea9ec47728ed76ffda0e8ddd7/users/e1511d477ce040fabeef91166dc509c9/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:23.518898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167b1da-7b50-4fb3-b7c8-8b04720ad5cf admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:23.593923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:23.646607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de13c3d-9157-4268-80c3-709b9e836e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:23.647478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13c3d-9157-4268-80c3-709b9e836e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.647832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13c3d-9157-4268-80c3-709b9e836e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.648288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13c3d-9157-4268-80c3-709b9e836e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.649109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de13c3d-9157-4268-80c3-709b9e836e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:23.653108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de13c3d-9157-4268-80c3-709b9e836e8d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:23.667075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 936/1878] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:23.671051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.684134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994111b6-dacd-4cb4-ac08-da9fc2da50bf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:23.691080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c574c-6166-4bf5-9248-1dd2813c4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:23.692805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c574c-6166-4bf5-9248-1dd2813c4b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.693274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c574c-6166-4bf5-9248-1dd2813c4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.693562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c574c-6166-4bf5-9248-1dd2813c4b0c admin admin] PATH_INFO: `/v3/projects/b86f72bea9ec47728ed76ffda0e8ddd7/users/e1511d477ce040fabeef91166dc509c9/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.695934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c574c-6166-4bf5-9248-1dd2813c4b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86f72bea9ec47728ed76ffda0e8ddd7, user_id=e1511d477ce040fabeef91166dc509c9, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:23.699619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c574c-6166-4bf5-9248-1dd2813c4b0c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:23.710422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bb06-9672-464a-849b-da8a142a533a None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.711091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bb06-9672-464a-849b-da8a142a533a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.711555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863bb06-9672-464a-849b-da8a142a533a None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.713736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 937/1879] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:59:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:59:23.746093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.746684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.747205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.749664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 943/1880] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:23 2022] PUT /identity/v3/projects/b86f72bea9ec47728ed76ffda0e8ddd7/users/e1511d477ce040fabeef91166dc509c9/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:23.757826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:23.758205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:23.758558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:23.802725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:23.815753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:23.821866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] MFA Rules not processed for user `e1511d477ce040fabeef91166dc509c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:23.823442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:23.947677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 944/1881] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:23.947677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.947677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:23.991486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 938/1882] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:23.994175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:23.996310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.058889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25879ed7-423d-4215-8739-f7846b8a95d3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:24.068145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:24.069572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.070120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.072016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] PATH_INFO: `/v3/projects/52faa65efd7941fd9f6977286695bfca` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.075403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52faa65efd7941fd9f6977286695bfca)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:24.080148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:24.102706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe334-d084-4acd-8aaa-fd65367cd92d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:24.110251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:24.111242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.111992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.112341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.128498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:24.141355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:24.165987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:24.174896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 939/1883] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:24.175888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:24.188672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.195618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52faa65efd7941fd9f6977286695bfca', 'request_id': 'req-3725700c-ca13-42d9-9f1a-6412ed4230e2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.217258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52faa65efd7941fd9f6977286695bfca', 'request_id': 'req-3725700c-ca13-42d9-9f1a-6412ed4230e2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.221975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511a8d-20c0-42d5-badb-7f7e08ad26c9 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:24.235726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52faa65efd7941fd9f6977286695bfca', 'request_id': 'req-3725700c-ca13-42d9-9f1a-6412ed4230e2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.317157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] The token cache is being invalidate because project 52faa65efd7941fd9f6977286695bfca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:24.317157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.320473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.324360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 945/1884] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:23 2022] DELETE /identity/v3/projects/52faa65efd7941fd9f6977286695bfca => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:24.325363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:24.326816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.397553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:24.400455 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.400818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.401090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] PATH_INFO: `/v3/projects/c318c218694943beb3fc66dfb262ee5f` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.402641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c318c218694943beb3fc66dfb262ee5f)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:24.408097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:24.410384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:24.513957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c318c218694943beb3fc66dfb262ee5f', 'request_id': 'req-d6586f7e-fcf1-4514-9317-af08b4607934'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.521283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725700c-ca13-42d9-9f1a-6412ed4230e2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:24.521515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c318c218694943beb3fc66dfb262ee5f', 'request_id': 'req-d6586f7e-fcf1-4514-9317-af08b4607934'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.532439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c318c218694943beb3fc66dfb262ee5f', 'request_id': 'req-d6586f7e-fcf1-4514-9317-af08b4607934'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.558348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] The token cache is being invalidate because project c318c218694943beb3fc66dfb262ee5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:24.559859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.561563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d6586f7e-fcf1-4514-9317-af08b4607934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.568317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 940/1885] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:24 2022] DELETE /identity/v3/projects/c318c218694943beb3fc66dfb262ee5f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:24.573084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1ca4c-8d7e-4583-b3fe-aeecdb0ce205 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.576664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1ca4c-8d7e-4583-b3fe-aeecdb0ce205 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.577513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1ca4c-8d7e-4583-b3fe-aeecdb0ce205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.621203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9db1ca4c-8d7e-4583-b3fe-aeecdb0ce205 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:24.622624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9db1ca4c-8d7e-4583-b3fe-aeecdb0ce205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.669183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:24.670113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.670475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.671935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.678804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.694186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:24.695759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:24.714262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 946/1886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:24.715734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:24.718376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.733269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 941/1887] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:24.737702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68422b8c-d647-4358-9d89-b3f451e16638 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:24.741802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.742094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.742374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.750297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:24.751827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.752136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.752417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] PATH_INFO: `/v3/users/2dc5a97bd3f341808fda97eb72c9f5f4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.759055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc5a97bd3f341808fda97eb72c9f5f4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:24.764496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:24.778125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:24.779996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.791819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 942/1888] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:24.801840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:24.816484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fdc75-e9ab-40d9-938d-90262eee4c7f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:24.830154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:24.831301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:24.831795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:24.832399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:24.833428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:24.833749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:24.835356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:24.849818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:24.857551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 943/1889] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:59:24.864695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:24.867905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.868177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc5a97bd3f341808fda97eb72c9f5f4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.886577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc5a97bd3f341808fda97eb72c9f5f4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.898911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc5a97bd3f341808fda97eb72c9f5f4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.916890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc5a97bd3f341808fda97eb72c9f5f4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.917704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc5a97bd3f341808fda97eb72c9f5f4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:24.928459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 947/1890] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:24 2022] DELETE /identity/v3/users/2dc5a97bd3f341808fda97eb72c9f5f4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:24.929531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:24.932484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:24.981132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a1e3-eb2e-43c6-b8f5-782e228282b8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.007065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:25.066635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf59281-2fed-4bf6-b238-cff1afcc2b74 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.073847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.074554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.074886 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.075322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.076110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.078867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.085438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1511d477ce040fabeef91166dc509c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.086389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.086683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.087538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.088702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:25.089013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.090725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.109270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 944/1891] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:25.110562 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.112557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:25.127382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 948/1892] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:24 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:25.131656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.138205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bea855-5edf-46b9-a581-eda70d3da96f tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.229136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b48be-bdd0-451b-aadc-4bbda1c6a44d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.234441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.235781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.236697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.237224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.238331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.241671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.262517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1511d477ce040fabeef91166dc509c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.263292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.263469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.263746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.264720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.266970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.281980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 949/1893] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:25 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:25.288349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.300994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 945/1894] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:25 2022] POST /identity/v3/projects => generated 355 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:25.302153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47bf9c-52b8-4e14-8942-9012a32de90d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.306129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.350429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:25.400876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09638d-3677-48ae-9d69-882f93ffc5b7 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.406308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1511d477ce040fabeef91166dc509c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.406996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.407335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.407621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.408410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:25.408720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.410354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.444730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 946/1895] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:59:25.457142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.457838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.458124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.458399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.459145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.461625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.489569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 950/1896] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:25.496198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.496424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.511318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a9b26-f969-47db-b15e-f9c0d9dc2b6a tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.514534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc33e2-2e10-4377-94f7-ea94616b8ace admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.525119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.525818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.526104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.526386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.527606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1511d477ce040fabeef91166dc509c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.528532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.528817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.529093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] PATH_INFO: `/v3/projects/dd988300bc434bd088be9b0986414cfa` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.530121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.531672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd988300bc434bd088be9b0986414cfa)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.532977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.536717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.564185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 947/1897] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:25.565110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.587056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810f81-b4c0-45dd-b857-66d652ed40e8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:25.602016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd988300bc434bd088be9b0986414cfa', 'request_id': 'req-6d60f946-b56e-4e20-8f5d-089221038c91'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:25.619484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd988300bc434bd088be9b0986414cfa', 'request_id': 'req-6d60f946-b56e-4e20-8f5d-089221038c91'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:25.620908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:25.630565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd988300bc434bd088be9b0986414cfa', 'request_id': 'req-6d60f946-b56e-4e20-8f5d-089221038c91'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:25.646353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] The token cache is being invalidate because project dd988300bc434bd088be9b0986414cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:25.646836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:25.647774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6d60f946-b56e-4e20-8f5d-089221038c91 tempest-VolumeQuotaClassesTest-2112882950 tempest-VolumeQuotaClassesTest-2112882950-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:25.649787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 951/1898] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:25 2022] DELETE /identity/v3/projects/dd988300bc434bd088be9b0986414cfa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:25.683704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:25.684723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.685076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.685426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] PATH_INFO: `/v3/projects/0c917b9d12794c7c9b7a38cfaa7c404e/users/aafa644d84e14803a590e966cbf08d71/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.706198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c917b9d12794c7c9b7a38cfaa7c404e, user_id=aafa644d84e14803a590e966cbf08d71, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:25.710006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:25.728885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 948/1899] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:25 2022] PUT /identity/v3/projects/0c917b9d12794c7c9b7a38cfaa7c404e/users/aafa644d84e14803a590e966cbf08d71/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:25.741773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:25.742126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:25.742339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:25.785667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] MFA Rules not processed for user `aafa644d84e14803a590e966cbf08d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:25.790737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:25.968852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 952/1900] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:25.973612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.975766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:25.980322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:25.984031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.064554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7f240-5736-47c5-913f-068ba2523f20 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.070823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.071837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.072157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.072446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.073521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.075168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.080864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:26.125241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266c25b-3d42-4295-9d38-a462d65545a2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.131040 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.132618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 949/1901] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:25 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:26.135373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.135749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.136066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] PATH_INFO: `/v3/users/1a3f1bd3946141359e0ef5064588f947` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.138427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3f1bd3946141359e0ef5064588f947)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.139874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.141240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.220836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3f1bd3946141359e0ef5064588f947'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.239376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3f1bd3946141359e0ef5064588f947'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.256809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3f1bd3946141359e0ef5064588f947'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.271009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ef9e5-a6b8-45b8-b8d8-be4ae8f8e2d6 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.279732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.282701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.283118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.283609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.284098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3f1bd3946141359e0ef5064588f947'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.284677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.285240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a39ef221-08b8-4dfb-bb88-9ace06ac3105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3f1bd3946141359e0ef5064588f947'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.287180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.304554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 953/1902] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:25 2022] DELETE /identity/v3/users/1a3f1bd3946141359e0ef5064588f947 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:26.309394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.319789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 950/1903] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:26 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:26.320188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.320523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.322184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.324371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.346327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7123f-4911-4cf3-89bc-63a4d6140413 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.376148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:26.377394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.387929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:26.506915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.508364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.509163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.509596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.510500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.512328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.531107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 954/1904] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:26.532037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.533692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 951/1905] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:26.537077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.538167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.553721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae5093-2d5b-47d4-9d01-479f88ec9cff admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.558100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62851e5f-f4bb-488b-9b4e-3b2090b887ff None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.566704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.569178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.569728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.570554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.570932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] PATH_INFO: `/v3/projects/37fe87c1f039457284b8694ecc18e079/users/bf1bf6e674ab4e938f742d0082940cd0/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.572763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.575155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.575524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] PATH_INFO: `/v3/projects/09a08f64ea5e459dab1374f10ccc1e13` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.576939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a08f64ea5e459dab1374f10ccc1e13)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.580109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.595484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fe87c1f039457284b8694ecc18e079, user_id=bf1bf6e674ab4e938f742d0082940cd0, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.598966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.626579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 952/1906] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:26 2022] PUT /identity/v3/projects/37fe87c1f039457284b8694ecc18e079/users/bf1bf6e674ab4e938f742d0082940cd0/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:26.633367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.636248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.655120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a08f64ea5e459dab1374f10ccc1e13', 'request_id': 'req-02a48b27-d24f-4402-93ec-39f68bd2f393'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.656591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:26.665477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a08f64ea5e459dab1374f10ccc1e13', 'request_id': 'req-02a48b27-d24f-4402-93ec-39f68bd2f393'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.693654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a08f64ea5e459dab1374f10ccc1e13', 'request_id': 'req-02a48b27-d24f-4402-93ec-39f68bd2f393'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.723650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] The token cache is being invalidate because project 09a08f64ea5e459dab1374f10ccc1e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:26.723938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.726216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:26.729954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 955/1907] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:26 2022] DELETE /identity/v3/projects/09a08f64ea5e459dab1374f10ccc1e13 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:26.731266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.736475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.753045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1d9a2-a2c0-4dc1-87ef-256f4137499e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.840443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.841419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.841891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a48b27-d24f-4402-93ec-39f68bd2f393 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.842187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.842686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.844990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.857120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bee18-0bcc-441a-a095-1f4624a1670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.858097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bee18-0bcc-441a-a095-1f4624a1670c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.858394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bee18-0bcc-441a-a095-1f4624a1670c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.858675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bee18-0bcc-441a-a095-1f4624a1670c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.859664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bee18-0bcc-441a-a095-1f4624a1670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.861732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bee18-0bcc-441a-a095-1f4624a1670c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.862698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.865579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.880945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 956/1908] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:26.880945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d4aa7-b216-4bac-984e-2ab154d6502a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.881194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d4aa7-b216-4bac-984e-2ab154d6502a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.881632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d4aa7-b216-4bac-984e-2ab154d6502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.883196 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 953/1909] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:26.884857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:26.907568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b48d4aa7-b216-4bac-984e-2ab154d6502a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:26.909423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b48d4aa7-b216-4bac-984e-2ab154d6502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.912924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8f3e-2915-4694-92c8-99dcde8cd70d service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:26.919181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79bb58-5503-4bf1-8dec-91e56ca0321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:26.919826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 957/1910] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:26.920221 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79bb58-5503-4bf1-8dec-91e56ca0321b admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.920487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79bb58-5503-4bf1-8dec-91e56ca0321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.920762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79bb58-5503-4bf1-8dec-91e56ca0321b admin admin] PATH_INFO: `/v3/projects/37fe87c1f039457284b8694ecc18e079/users/bf1bf6e674ab4e938f742d0082940cd0/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.923243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79bb58-5503-4bf1-8dec-91e56ca0321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fe87c1f039457284b8694ecc18e079, user_id=bf1bf6e674ab4e938f742d0082940cd0, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:26.926200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79bb58-5503-4bf1-8dec-91e56ca0321b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:26.927400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.928630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.929077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:26.948971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 954/1911] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:26 2022] PUT /identity/v3/projects/37fe87c1f039457284b8694ecc18e079/users/bf1bf6e674ab4e938f742d0082940cd0/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:26.952323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:26.953700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:26.958932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578cc5d-a1c9-47f6-9d7f-572f78d89878 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:26.959670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578cc5d-a1c9-47f6-9d7f-572f78d89878 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:26.959911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578cc5d-a1c9-47f6-9d7f-572f78d89878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.042114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7578cc5d-a1c9-47f6-9d7f-572f78d89878 None None] MFA Rules not processed for user `bf1bf6e674ab4e938f742d0082940cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:27.044978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7578cc5d-a1c9-47f6-9d7f-572f78d89878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:27.065302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 958/1912] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:27.070566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.102393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbc322-fec6-48e8-ab73-eafd87d02f1a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.112897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:27.118578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.120478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.121626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.122200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.122842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:27.123269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.127245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687de26-bb7e-4fee-9db8-685c2ccc637d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.160936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 959/1913] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:27.162577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f57f2e-aa6b-4b78-acaf-79e1f9bbfa37 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.163045 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f57f2e-aa6b-4b78-acaf-79e1f9bbfa37 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.163335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f57f2e-aa6b-4b78-acaf-79e1f9bbfa37 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.164921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 960/1914] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 09:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 09:59:27.165655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f57f2e-aa6b-4b78-acaf-79e1f9bbfa37 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.190716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f57f2e-aa6b-4b78-acaf-79e1f9bbfa37 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.204453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.205911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.206199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.206586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.207670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.209948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.229553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 955/1915] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:27.233652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.233652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.233652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.280327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 961/1916] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:27 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:27.281481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.285427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:27.353036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:27.398473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868e91-6618-45c9-ae6d-6df1a4eb2cf1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.407696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.408588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.408880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.409162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.411247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:27.445313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:27.449334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:27.506074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.509148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.524730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 962/1917] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:27.526445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.648902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e30a-7502-4f72-a865-df434255a5e7 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.654195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.654962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.655147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.655426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.656159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.658714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.670259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 956/1918] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 09:59:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:27.692694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 963/1919] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:27 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:27.696761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.711345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ece892-7c07-4e29-9f9b-3c75e4f1a6f6 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.719783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.726173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:27.727216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.728531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.728818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.729098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.730150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.733806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.765721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 957/1920] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:27.768099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8030c5a-de49-4d8e-9a0d-0907b796a2b6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.768878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.782521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82323c-6d20-4cbf-b1c3-ff2194e70edf admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.784914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2121-16ca-4ea7-a343-c12acd5371ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.785742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2121-16ca-4ea7-a343-c12acd5371ed service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.786367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2121-16ca-4ea7-a343-c12acd5371ed service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.786507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2121-16ca-4ea7-a343-c12acd5371ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.792290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.793193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.793617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.794316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.795485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.797631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.810304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2121-16ca-4ea7-a343-c12acd5371ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.812408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2121-16ca-4ea7-a343-c12acd5371ed service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.816917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 958/1921] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:27.822925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:27.835448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 964/1922] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:27.839661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8210d8-0511-4036-9746-46e574dbfc55 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:27.853678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:27.856539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.856865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.857121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] PATH_INFO: `/v3/projects/d6cd1f11291143a79c31f3216bee76b5/users/3eda599cc48a400dba427df9170441a2/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.894674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cd1f11291143a79c31f3216bee76b5, user_id=3eda599cc48a400dba427df9170441a2, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:27.902316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:27.938171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 959/1923] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:27 2022] PUT /identity/v3/projects/d6cd1f11291143a79c31f3216bee76b5/users/3eda599cc48a400dba427df9170441a2/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:27.940473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:27.940888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:27.941201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:27.976852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] MFA Rules not processed for user `3eda599cc48a400dba427df9170441a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:27.978875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:28.064315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:28.098633 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 965/1924] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:28.114945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:28.116980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:28.118028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:28.246929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10df1d-0216-4668-9020-7962fcf00fda None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:28.252785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:28.254469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:28.255348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:28.256018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:28.273619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:28.276938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:28.292353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 966/1925] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:28.316974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:28.317775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee229e-da77-4ec9-8476-80fb61bfd14b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:28.332689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:28.333710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:28.333986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:28.334263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] PATH_INFO: `/v3/projects/1e607c0de24a404fb4429af40634b7b0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:28.336068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e607c0de24a404fb4429af40634b7b0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:28.340995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:28.346460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879995a8-be86-41a8-b615-0a39ba9bda4a service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:28.358255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:28.359270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:28.359616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:28.360227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] PATH_INFO: `/v3/users/3eda599cc48a400dba427df9170441a2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:28.361234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:28.362422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eda599cc48a400dba427df9170441a2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:28.367444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:28.447459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e607c0de24a404fb4429af40634b7b0', 'request_id': 'req-55cfac2f-0dab-4ce7-b5ef-b11170451151'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.448730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eda599cc48a400dba427df9170441a2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.459612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e607c0de24a404fb4429af40634b7b0', 'request_id': 'req-55cfac2f-0dab-4ce7-b5ef-b11170451151'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.473331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e607c0de24a404fb4429af40634b7b0', 'request_id': 'req-55cfac2f-0dab-4ce7-b5ef-b11170451151'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.473524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eda599cc48a400dba427df9170441a2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.487305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] The token cache is being invalidate because project 1e607c0de24a404fb4429af40634b7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:28.487600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.488343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.490021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eda599cc48a400dba427df9170441a2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.494123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 960/1926] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:28 2022] DELETE /identity/v3/projects/1e607c0de24a404fb4429af40634b7b0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:28.495148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:28.496915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:28.500289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eda599cc48a400dba427df9170441a2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.501230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e77d1edc-5ee8-48c2-a475-df197f2b2d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eda599cc48a400dba427df9170441a2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.511263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 967/1927] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:28 2022] DELETE /identity/v3/users/3eda599cc48a400dba427df9170441a2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:28.515611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:28.515907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:28.516227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:28.534915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:28.536429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:28.577528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfac2f-0dab-4ce7-b5ef-b11170451151 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:28.606072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 968/1928] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:28.615435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:28.617096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:28.628520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:28.644572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:28.645676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:28.646161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:28.646515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] PATH_INFO: `/v3/users/e1511d477ce040fabeef91166dc509c9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:28.647822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1511d477ce040fabeef91166dc509c9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:28.649979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:28.691445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c1f68-cad8-44f1-b822-d326cdaebab3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:28.695525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:28.696781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:28.697078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:28.697466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:28.705953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:28.708343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1511d477ce040fabeef91166dc509c9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.709457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:28.710998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:28.722639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 969/1929] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:28.724752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1511d477ce040fabeef91166dc509c9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.725518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1511d477ce040fabeef91166dc509c9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.732666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1511d477ce040fabeef91166dc509c9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.741151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1511d477ce040fabeef91166dc509c9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:28.749509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 961/1930] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:28 2022] DELETE /identity/v3/users/e1511d477ce040fabeef91166dc509c9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:29.032828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.034389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.064175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4494f51-5efd-4e0f-bd7e-4d458b4eb930 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.124966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.126591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.144922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.145999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.146363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.146720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] PATH_INFO: `/v3/projects/b86f72bea9ec47728ed76ffda0e8ddd7` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.148151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86f72bea9ec47728ed76ffda0e8ddd7)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.150556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.195839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e949b-b7e4-4317-bbd9-0d9cc8465f2d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.209369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'request_id': 'req-2cf9b058-6862-4973-b7aa-1820144ef348'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.217999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'request_id': 'req-2cf9b058-6862-4973-b7aa-1820144ef348'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.228168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86f72bea9ec47728ed76ffda0e8ddd7', 'request_id': 'req-2cf9b058-6862-4973-b7aa-1820144ef348'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.241105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] The token cache is being invalidate because project b86f72bea9ec47728ed76ffda0e8ddd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:29.241401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.242206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2cf9b058-6862-4973-b7aa-1820144ef348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.248250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 970/1931] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:29 2022] DELETE /identity/v3/projects/b86f72bea9ec47728ed76ffda0e8ddd7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:29.249958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969d277-7ea3-4e37-8850-429de4442d83 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.250299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969d277-7ea3-4e37-8850-429de4442d83 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.250639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969d277-7ea3-4e37-8850-429de4442d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.272162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5969d277-7ea3-4e37-8850-429de4442d83 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:29.274901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5969d277-7ea3-4e37-8850-429de4442d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.276636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.278313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.278667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.279008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] PATH_INFO: `/v3/projects/d6cd1f11291143a79c31f3216bee76b5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.280530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cd1f11291143a79c31f3216bee76b5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.282497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.292270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 971/1932] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:29.294796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.295092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.295742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.315381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:29.316652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.325798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 972/1933] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:29.331135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.339487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cd1f11291143a79c31f3216bee76b5', 'request_id': 'req-cd53f92a-dc07-48d1-92c2-949747cbea40'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.343395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a90c9-2da2-4eb1-9f7e-5c766cfe5181 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.352199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cd1f11291143a79c31f3216bee76b5', 'request_id': 'req-cd53f92a-dc07-48d1-92c2-949747cbea40'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.365628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cd1f11291143a79c31f3216bee76b5', 'request_id': 'req-cd53f92a-dc07-48d1-92c2-949747cbea40'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.373009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:29.404695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:29.411836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] The token cache is being invalidate because project d6cd1f11291143a79c31f3216bee76b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:29.412314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.417513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.420657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.421283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-cd53f92a-dc07-48d1-92c2-949747cbea40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:29.421808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.422238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.422985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 962/1934] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:29 2022] DELETE /identity/v3/projects/d6cd1f11291143a79c31f3216bee76b5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:29.426889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:29.427490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.427629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deb5f5-1856-4e0a-a2e2-0918b98e39c4 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.427922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deb5f5-1856-4e0a-a2e2-0918b98e39c4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.429144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deb5f5-1856-4e0a-a2e2-0918b98e39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.429803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.446597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 973/1935] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:59:29.451072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.456454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.473024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-92deb5f5-1856-4e0a-a2e2-0918b98e39c4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:29.474394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-92deb5f5-1856-4e0a-a2e2-0918b98e39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.485308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab688119-46b0-4bb8-8745-96a6b7623c48 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.492602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.493277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.493563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.493841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.494647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.497028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.515139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 963/1936] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:29.529487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.529805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.530090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.537815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 974/1937] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:29.544390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.590724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:29.592169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:29.622174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c343e28-6d7b-4237-bef4-a97134b697ae admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.628421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.629551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.629551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.629923 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.631184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.633233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.662598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 975/1938] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:29.669508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.681953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5702ab-ad18-4376-a645-b67794f6c9fc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.688644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.689807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.690096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.690373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.691415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.696689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.697294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 964/1939] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:29.699468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.708355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 976/1940] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:29.712760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.713258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666a552-b4da-4cef-acf2-7a53e732b24a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.724728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.725674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.726227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.726715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.727265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd81a4-6315-4088-b32e-38e1b8d66aa8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.728134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:29.728634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.730810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.734423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.735667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.735946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.736850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.737767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.740727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.755771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 965/1941] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:29.757677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.761860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 977/1942] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:29.768213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.770654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e58c0-17ef-483e-bc90-3a2b990da88c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.777057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.777775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.778060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.778524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.779481 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.782413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.794641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f92029-6908-4d64-8dd0-5decf5333c21 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:29.811029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb372b-71f6-4abe-bf0d-8ec479c2a886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:29.815594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb372b-71f6-4abe-bf0d-8ec479c2a886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.815837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb372b-71f6-4abe-bf0d-8ec479c2a886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.816146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb372b-71f6-4abe-bf0d-8ec479c2a886 admin admin] PATH_INFO: `/v3/projects/57c29c78cd0a4518bc15ff824603be5b/users/74b7ac01a7c44e72a9e21dfd4c08a355/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:29.846860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 966/1943] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:29.848950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:29.857173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb372b-71f6-4abe-bf0d-8ec479c2a886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c29c78cd0a4518bc15ff824603be5b, user_id=74b7ac01a7c44e72a9e21dfd4c08a355, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:29.872838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb372b-71f6-4abe-bf0d-8ec479c2a886 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:29.909853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 978/1944] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:29 2022] PUT /identity/v3/projects/57c29c78cd0a4518bc15ff824603be5b/users/74b7ac01a7c44e72a9e21dfd4c08a355/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:29.921589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:29.922089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:29.922291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.002156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] MFA Rules not processed for user `74b7ac01a7c44e72a9e21dfd4c08a355`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:30.003416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:30.020770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5abd6b-cbd5-486b-9cdf-483203a9c02f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.098059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:30.138499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.140173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.140659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.141045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.141869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.144125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.154704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:30.176207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 967/1945] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:30.179102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.203704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d59f-3d25-4655-81a3-ab6295ead984 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.212346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 979/1946] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:30.213643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.218614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.219717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.220182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.220606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.221782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.226825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.246663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb608d-e838-4825-be2f-9fb0d4f3d3a0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.254743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 968/1947] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:30.257670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.263572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.266126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.267538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.268475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.271744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.276014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.279910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaa74c-8dc4-44b4-87c2-061d6124a84a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.298758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.299707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.300011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.300395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.301257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.307525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.328877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 980/1948] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:30 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:30.332372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 969/1949] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:30.334053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.335246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.359584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c49be-8f0f-4717-a7d8-d76279fe0e82 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.505087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df894c-cbf1-4cf0-b134-3f41b082c885 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.516763 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729caf6f-84c7-41fc-90b2-e25d3bf8a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.517690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729caf6f-84c7-41fc-90b2-e25d3bf8a2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.517962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729caf6f-84c7-41fc-90b2-e25d3bf8a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.518243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729caf6f-84c7-41fc-90b2-e25d3bf8a2a5 admin admin] PATH_INFO: `/v3/projects/af182e9c3d664d26b85667b9d89c6cf2/users/4d9ed04becca4e089e621db66d46a9f9/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.520807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.521501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.521787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.522072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.524563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.527523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.556151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729caf6f-84c7-41fc-90b2-e25d3bf8a2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af182e9c3d664d26b85667b9d89c6cf2, user_id=4d9ed04becca4e089e621db66d46a9f9, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.558836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729caf6f-84c7-41fc-90b2-e25d3bf8a2a5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.569265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 981/1950] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:30 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:30.570688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.590930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c243-e0b6-48fd-b0c4-d16cf4db881e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.596552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 970/1951] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:30 2022] PUT /identity/v3/projects/af182e9c3d664d26b85667b9d89c6cf2/users/4d9ed04becca4e089e621db66d46a9f9/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:30.598082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.598374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.598653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.647416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] MFA Rules not processed for user `4d9ed04becca4e089e621db66d46a9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:30.648787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:30.732526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 971/1952] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:30.746551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.750988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.751686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.751993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.752281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.753025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.754648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.756896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:30.784251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 982/1953] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:30.787216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.809652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a187534-f4f6-4c28-8fd2-8d6e2c460d97 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.822184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.823097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.823384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.823665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] PATH_INFO: `/v3/projects/0bc5fd8cf92d4fe3b0eb3b99177ea2f9/users/30d7e690e4304513b9684e1a245ca40c/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:30.847221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc5fd8cf92d4fe3b0eb3b99177ea2f9, user_id=30d7e690e4304513b9684e1a245ca40c, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:30.851230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:30.866255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:30.874989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 983/1954] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:30 2022] PUT /identity/v3/projects/0bc5fd8cf92d4fe3b0eb3b99177ea2f9/users/30d7e690e4304513b9684e1a245ca40c/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:30.877651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:30.882446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3720ab4-66af-4c53-bab1-2be35a258cb6 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:30.902753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:30.981060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:30.981947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:30.982229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:30.982532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:31.004831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b10273-7d50-488c-a405-3164ea3fa264 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:31.019241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:31.019713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:31.020109 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:31.020397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:31.021210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:31.022853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:31.040485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 984/1955] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:31.043892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:31.055440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963e3cc-d182-403c-b256-192f502bf6a5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:31.060828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94661cfa-0352-451d-9cc7-9d0dd183bc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:31.062003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94661cfa-0352-451d-9cc7-9d0dd183bc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:31.062513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94661cfa-0352-451d-9cc7-9d0dd183bc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:31.062979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94661cfa-0352-451d-9cc7-9d0dd183bc9d admin admin] PATH_INFO: `/v3/projects/0bc5fd8cf92d4fe3b0eb3b99177ea2f9/users/30d7e690e4304513b9684e1a245ca40c/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:31.065374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94661cfa-0352-451d-9cc7-9d0dd183bc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc5fd8cf92d4fe3b0eb3b99177ea2f9, user_id=30d7e690e4304513b9684e1a245ca40c, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:31.068212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94661cfa-0352-451d-9cc7-9d0dd183bc9d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:31.091104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 985/1956] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:31 2022] PUT /identity/v3/projects/0bc5fd8cf92d4fe3b0eb3b99177ea2f9/users/30d7e690e4304513b9684e1a245ca40c/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:31.093205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:31.093583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:31.094215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:31.094409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:31.103081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:31.117815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 972/1957] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:31.151875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] MFA Rules not processed for user `30d7e690e4304513b9684e1a245ca40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:31.155533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:31.296175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 986/1958] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:31.312589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:31.314058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:31.374004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059bc23-a834-4ffb-aace-253fff315213 service glance] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:31.429420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:31.430344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:31.431336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:31.431734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:31.442095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:31.443589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:31.453670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 973/1959] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:31.779108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:31.780713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:31.799627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569a922-eb12-472a-a3fa-4ca73bf83b83 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:31.819645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:31.820471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:31.820762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:31.821204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:31.972157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:31.973984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:31.998270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 987/1960] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:33.022570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:33.031545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f2190-4d4f-47d1-a3b1-0286432b3e17 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:33.035175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:33.035811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:33.036147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:33.036409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:33.038163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:33.053474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:33.106500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:33.108131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac0b86-fee4-42a9-a3c5-97f8181ca464 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:33.118743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 974/1961] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:37.632463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:37.660761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:37.719216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1d52-cbd2-4fb3-a5f1-3f01b558c400 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:37.723911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:37.724821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:37.725107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:37.725386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] PATH_INFO: `/v3/users/74b7ac01a7c44e72a9e21dfd4c08a355` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:37.726588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b7ac01a7c44e72a9e21dfd4c08a355)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:37.729175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:37.794300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b7ac01a7c44e72a9e21dfd4c08a355'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:37.808545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b7ac01a7c44e72a9e21dfd4c08a355'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:37.819245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b7ac01a7c44e72a9e21dfd4c08a355'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:37.827838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b7ac01a7c44e72a9e21dfd4c08a355'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:37.828843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b7ac01a7c44e72a9e21dfd4c08a355'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:37.837672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 988/1962] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:37 2022] DELETE /identity/v3/users/74b7ac01a7c44e72a9e21dfd4c08a355 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:37.842587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:37.842587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:37.843200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:37.865174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:37.866583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:37.938450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 975/1963] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:37.949612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:37.951240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.021257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a022-8fcf-4519-8ec2-7377adbc9345 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:38.025659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bd0e7-402a-43b7-a8fa-72fb752e9ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:38.026317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd0e7-402a-43b7-a8fa-72fb752e9ced service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:38.026603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd0e7-402a-43b7-a8fa-72fb752e9ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:38.026896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bd0e7-402a-43b7-a8fa-72fb752e9ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:38.038357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bd0e7-402a-43b7-a8fa-72fb752e9ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:38.040097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bd0e7-402a-43b7-a8fa-72fb752e9ced service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:38.051532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 989/1964] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:38.251901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:38.253417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.266960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aef781-9579-44c7-a09f-169fb2933392 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:38.276400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:38.277828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:38.278113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:38.278387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] PATH_INFO: `/v3/users/aafa644d84e14803a590e966cbf08d71` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:38.279598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafa644d84e14803a590e966cbf08d71)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:38.281631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:38.345113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafa644d84e14803a590e966cbf08d71'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.370587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafa644d84e14803a590e966cbf08d71'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.371581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafa644d84e14803a590e966cbf08d71'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.379621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafa644d84e14803a590e966cbf08d71'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.389101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafa644d84e14803a590e966cbf08d71'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.398334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 976/1965] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:38 2022] DELETE /identity/v3/users/aafa644d84e14803a590e966cbf08d71 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:38.402823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:38.403186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:38.403537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:38.432318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:38.433721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.437435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:38.439364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.479696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:38.489404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:38.513390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 990/1966] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:38.523054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:38.523829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d049b9-47b8-4e3f-91f6-5e6dd135d47f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:38.524426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.528810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:38.529691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:38.529974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:38.530256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] PATH_INFO: `/v3/projects/57c29c78cd0a4518bc15ff824603be5b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:38.531499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c29c78cd0a4518bc15ff824603be5b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:38.533465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:38.586506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c29c78cd0a4518bc15ff824603be5b', 'request_id': 'req-d4bcb210-8f7e-4de3-bbce-d789f17e9831'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.588858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50069d-150d-4ce7-8825-e3331ed937cc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:38.592924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c29c78cd0a4518bc15ff824603be5b', 'request_id': 'req-d4bcb210-8f7e-4de3-bbce-d789f17e9831'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.601339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c29c78cd0a4518bc15ff824603be5b', 'request_id': 'req-d4bcb210-8f7e-4de3-bbce-d789f17e9831'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.613523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] The token cache is being invalidate because project 57c29c78cd0a4518bc15ff824603be5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:38.613807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.614458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.616292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 977/1967] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:38 2022] DELETE /identity/v3/projects/57c29c78cd0a4518bc15ff824603be5b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:38.620282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:38.621570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.644471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:38.645140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:38.645421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:38.645697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:38.647425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:38.689195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcb210-8f7e-4de3-bbce-d789f17e9831 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:38.698155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:38.699079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:38.699363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:38.699635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] PATH_INFO: `/v3/users/30d7e690e4304513b9684e1a245ca40c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:38.700887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d7e690e4304513b9684e1a245ca40c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:38.702890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:38.720663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:38.722090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:38.732489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 991/1968] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:38.775888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d7e690e4304513b9684e1a245ca40c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.788076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:38.796012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d7e690e4304513b9684e1a245ca40c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.796917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d7e690e4304513b9684e1a245ca40c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.805814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d7e690e4304513b9684e1a245ca40c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.819887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d7e690e4304513b9684e1a245ca40c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:38.830669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 978/1969] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:38 2022] DELETE /identity/v3/users/30d7e690e4304513b9684e1a245ca40c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:39.280831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:39.282373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:39.295157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4c3b7-899f-4b11-8493-2629d88c2e15 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:39.380068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:39.398426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:39.399389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:39.399679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:39.399967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] PATH_INFO: `/v3/projects/0c917b9d12794c7c9b7a38cfaa7c404e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:39.401259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c917b9d12794c7c9b7a38cfaa7c404e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:39.403178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:39.446405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:39.448197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:39.466755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c917b9d12794c7c9b7a38cfaa7c404e', 'request_id': 'req-80f3f7de-3aa2-4acb-80a6-7190560f0a99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.472444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19012-c5f3-45cf-946f-6f59bdd6eb01 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:39.474382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c917b9d12794c7c9b7a38cfaa7c404e', 'request_id': 'req-80f3f7de-3aa2-4acb-80a6-7190560f0a99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.486655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c917b9d12794c7c9b7a38cfaa7c404e', 'request_id': 'req-80f3f7de-3aa2-4acb-80a6-7190560f0a99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.501681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] The token cache is being invalidate because project 0c917b9d12794c7c9b7a38cfaa7c404e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:39.502263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.503048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.505099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 992/1970] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:39 2022] DELETE /identity/v3/projects/0c917b9d12794c7c9b7a38cfaa7c404e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:39.510442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:39.512008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:39.591426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:39.593039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:39.593319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:39.593885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] PATH_INFO: `/v3/projects/0bc5fd8cf92d4fe3b0eb3b99177ea2f9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:39.595672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc5fd8cf92d4fe3b0eb3b99177ea2f9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:39.599809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:39.648323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3f7de-3aa2-4acb-80a6-7190560f0a99 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:39.656118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:39.657171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:39.657527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:39.657882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] PATH_INFO: `/v3/users/bf1bf6e674ab4e938f742d0082940cd0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:39.659263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1bf6e674ab4e938f742d0082940cd0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:39.661853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:39.679693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc5fd8cf92d4fe3b0eb3b99177ea2f9', 'request_id': 'req-44f69203-d08f-4825-88eb-8099989ff80c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.690580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc5fd8cf92d4fe3b0eb3b99177ea2f9', 'request_id': 'req-44f69203-d08f-4825-88eb-8099989ff80c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.699617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc5fd8cf92d4fe3b0eb3b99177ea2f9', 'request_id': 'req-44f69203-d08f-4825-88eb-8099989ff80c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.723883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] The token cache is being invalidate because project 0bc5fd8cf92d4fe3b0eb3b99177ea2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:39.724209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.725307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-44f69203-d08f-4825-88eb-8099989ff80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.731223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 979/1971] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:39 2022] DELETE /identity/v3/projects/0bc5fd8cf92d4fe3b0eb3b99177ea2f9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:39.733384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:39.733681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:39.733978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:39.734459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1bf6e674ab4e938f742d0082940cd0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.752857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1bf6e674ab4e938f742d0082940cd0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.763460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1bf6e674ab4e938f742d0082940cd0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.763794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:39.766076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:39.773694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1bf6e674ab4e938f742d0082940cd0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.775289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d350a5d7-39da-448b-80da-eb7aca823715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1bf6e674ab4e938f742d0082940cd0'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:39.777739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:39.791019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 993/1972] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:39 2022] DELETE /identity/v3/users/bf1bf6e674ab4e938f742d0082940cd0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:39.862643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 980/1973] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:39.872211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:39.873211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:39.873211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:39.913889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:39.915778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.000464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 994/1974] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:40.004391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.010755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:40.021683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165f304-da33-43ad-ad21-95acdc070719 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.034721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.035404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.035689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.035969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.036723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:40.037032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.038627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.068605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 981/1975] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:40.073482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.083152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63442ff-1571-4909-879a-e081092c80b0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.092345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.092998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.093283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.093569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.094970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.097620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.134598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 995/1976] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/projects => generated 361 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:40.136114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.154713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df76f2-0391-4bda-bffa-03d6883ca9f5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.252861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.253824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.254690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.254690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.255362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.257348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.288648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.296101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 982/1977] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/users => generated 281 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:40.305817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c82e0f-a803-4149-919d-57cd246ac18e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.307461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.309561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.310968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.311717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.312032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.312374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.313409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.315168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.335647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df237f50-2813-4e64-961f-a35d54bd7da4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.342715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.344421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 996/1978] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:40.345373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.352908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.353256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.353610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] PATH_INFO: `/v3/projects/37fe87c1f039457284b8694ecc18e079` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.355413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fe87c1f039457284b8694ecc18e079)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.356275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e0807-a179-4bf3-82de-6ff3c9055bb7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.358600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.377128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.377814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.378103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.380278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.381687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.385789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.406058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 997/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:40.413463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.425885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608fc25-4f33-4fab-8b27-71e66e70483c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.439096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fe87c1f039457284b8694ecc18e079', 'request_id': 'req-1ca8ee42-74f3-4f1e-b8c3-b85145944065'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:40.448641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fe87c1f039457284b8694ecc18e079', 'request_id': 'req-1ca8ee42-74f3-4f1e-b8c3-b85145944065'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:40.460014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fe87c1f039457284b8694ecc18e079', 'request_id': 'req-1ca8ee42-74f3-4f1e-b8c3-b85145944065'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:40.472670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] The token cache is being invalidate because project 37fe87c1f039457284b8694ecc18e079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:40.473075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:40.473811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1ca8ee42-74f3-4f1e-b8c3-b85145944065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:40.476039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 983/1980] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:40 2022] DELETE /identity/v3/projects/37fe87c1f039457284b8694ecc18e079 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:40.482232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b260d-5a70-4e5d-aa7c-35b22998e314 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.482718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b260d-5a70-4e5d-aa7c-35b22998e314 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.483173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b260d-5a70-4e5d-aa7c-35b22998e314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.495567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578007-bd0d-4b26-ae44-b71c17f35953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.496608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578007-bd0d-4b26-ae44-b71c17f35953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.497009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578007-bd0d-4b26-ae44-b71c17f35953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.497361 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578007-bd0d-4b26-ae44-b71c17f35953 admin admin] PATH_INFO: `/v3/projects/033f01a03dc84fdc92681c33c772021b/users/f569485c090f4b948ac91a08c1e9a6c8/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.504545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f96b260d-5a70-4e5d-aa7c-35b22998e314 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:40.505838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f96b260d-5a70-4e5d-aa7c-35b22998e314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.513309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578007-bd0d-4b26-ae44-b71c17f35953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033f01a03dc84fdc92681c33c772021b, user_id=f569485c090f4b948ac91a08c1e9a6c8, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.515338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 984/1981] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:40.516300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578007-bd0d-4b26-ae44-b71c17f35953 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.523718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.524115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.527334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.543396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 998/1982] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:40 2022] PUT /identity/v3/projects/033f01a03dc84fdc92681c33c772021b/users/f569485c090f4b948ac91a08c1e9a6c8/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:40.547776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.548101 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.548384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.551370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:40.552760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.588129 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] MFA Rules not processed for user `f569485c090f4b948ac91a08c1e9a6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:40.589510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.618389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:40.623770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:40.634677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 985/1983] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:40.638957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.648318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cb3ad-5b0a-41cb-8691-116eb3d35f42 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.653229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.653927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.654169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.654490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.655210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:40.655580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.657298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.670121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 986/1984] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:40.673753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 999/1985] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:40.681161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.699188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39bfc6-4635-4cac-9717-57bb353126ad admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.704307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.705125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.705415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.705712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.706498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.707925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.709402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.717795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.754027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 987/1986] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:40.757808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.781304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97f7d0-1e07-4ab6-9162-8dbf027a24d7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.846099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe681-257d-4b39-a190-14b59591817b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.851550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.851785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.852781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.853497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.853700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.853784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.853857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.853857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.854142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.856583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.884182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 988/1987] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:40 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:40.885024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.897753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2403cd6-bd85-419e-9cbd-6ec14316a305 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.904126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.904981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.905270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.905551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.906903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.908368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.920605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 989/1988] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:40.924494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.927708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.929445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.938358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a31da-54be-4934-9a89-56bece4e1122 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.944153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1000/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 09:59:40.944503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.945172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.945450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.945814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.946586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:40.948188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:40.958899 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 990/1990] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:40.960764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.962692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:40.963169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:40.979595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933934c-9806-4dac-a3cd-98f3b328b7c5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.984829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30477b0-8649-4224-9fc2-159ef511892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.986018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30477b0-8649-4224-9fc2-159ef511892e admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.986302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30477b0-8649-4224-9fc2-159ef511892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.986578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30477b0-8649-4224-9fc2-159ef511892e admin admin] PATH_INFO: `/v3/projects/067cf95468f849dc838fff22972630b1/users/ab492b1fc2994405a6ae3a4b61338518/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.990597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3b6f3-6ce3-4ff4-b799-5887f3955515 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:40.996035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:40.996922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:40.997334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:40.997623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] PATH_INFO: `/v3/users/f569485c090f4b948ac91a08c1e9a6c8` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:40.999347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f569485c090f4b948ac91a08c1e9a6c8)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:41.001335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:41.005062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30477b0-8649-4224-9fc2-159ef511892e admin admin] RBAC: Authorizing `identity:create_grant(project_id=067cf95468f849dc838fff22972630b1, user_id=ab492b1fc2994405a6ae3a4b61338518, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:41.008840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30477b0-8649-4224-9fc2-159ef511892e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:41.027587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 991/1991] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:40 2022] PUT /identity/v3/projects/067cf95468f849dc838fff22972630b1/users/ab492b1fc2994405a6ae3a4b61338518/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:41.040736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:41.041045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:41.041473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:41.042911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:41.061909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f569485c090f4b948ac91a08c1e9a6c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.079951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] MFA Rules not processed for user `ab492b1fc2994405a6ae3a4b61338518`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:41.082054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:41.082175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f569485c090f4b948ac91a08c1e9a6c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.094781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f569485c090f4b948ac91a08c1e9a6c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.114343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f569485c090f4b948ac91a08c1e9a6c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.115524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-41f914c7-998d-468a-be11-4cbb3194bb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f569485c090f4b948ac91a08c1e9a6c8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.123806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1001/1992] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:40 2022] DELETE /identity/v3/users/f569485c090f4b948ac91a08c1e9a6c8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:41.128167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:41.128734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:41.129401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:41.154968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:41.155950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:41.162865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:41.177405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 992/1993] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:41.198215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:41.199726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:41.239447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1002/1994] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:41.240579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:41.241953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:41.284594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea52a1-dd39-4223-b2d4-6c215d06da82 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:41.333947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e983131-987c-461e-9d17-3818e8565c1b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:41.338656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:41.339623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:41.339623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:41.339912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:41.351647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:41.353899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:41.356132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a689f-8731-4762-9247-111836688102 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:41.360592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a689f-8731-4762-9247-111836688102 service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:41.360986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a689f-8731-4762-9247-111836688102 service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:41.361271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a689f-8731-4762-9247-111836688102 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:41.367803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1003/1995] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:41.455237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a689f-8731-4762-9247-111836688102 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:41.457058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a689f-8731-4762-9247-111836688102 service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:41.500212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 993/1996] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:41.768898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:41.770483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:41.800887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fe9a-908e-4c82-9e18-d80b5086511c service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:41.806203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:41.807216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:41.807507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:41.807838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] PATH_INFO: `/v3/projects/033f01a03dc84fdc92681c33c772021b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:41.809420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033f01a03dc84fdc92681c33c772021b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:41.811457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:41.882097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:41.884504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033f01a03dc84fdc92681c33c772021b', 'request_id': 'req-f3cd4434-4ab4-4def-8680-dffcddb6f249'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.894694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033f01a03dc84fdc92681c33c772021b', 'request_id': 'req-f3cd4434-4ab4-4def-8680-dffcddb6f249'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.911053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033f01a03dc84fdc92681c33c772021b', 'request_id': 'req-f3cd4434-4ab4-4def-8680-dffcddb6f249'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.924924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] The token cache is being invalidate because project 033f01a03dc84fdc92681c33c772021b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:41.925225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.926340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3cd4434-4ab4-4def-8680-dffcddb6f249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:41.932811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1004/1997] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:41 2022] DELETE /identity/v3/projects/033f01a03dc84fdc92681c33c772021b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:41.935022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:41.935513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:41.935855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:41.959602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:41.960967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:42.043603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 994/1998] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 09:59:42.050958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.051081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.051307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.077473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:42.079171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:42.091132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1005/1999] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:42.106751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.115120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:42.120778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbeb86-71c7-42fa-8327-21c5bf0ce8c9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.131314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.131314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.131314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.131314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.131946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:42.131946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.131946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.153298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.158592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 995/2000] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 09:59:42.171094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa22df-2efc-4d7a-8ec6-cfed400be0b9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.178455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.179407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.179748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.179989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.181349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.184570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.237360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1006/2001] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:42 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:42.238611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.252297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb9d1-959b-4648-856b-1228ecf41290 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.321904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.322583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.322935 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.323276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.324112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.326102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.346483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 996/2002] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:42 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 09:59:42.350355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.361626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdb023-32c5-422f-8606-9beded83b5ed admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.366376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.367042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.367330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.367622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.369111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.370808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.381679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1007/2003] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:42.386001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.396208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace5f86-5ae6-4df0-b8f4-fa16fb0fc33a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.400910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adfecf-e299-4fd1-99cd-870b71b82505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.401575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adfecf-e299-4fd1-99cd-870b71b82505 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.401857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adfecf-e299-4fd1-99cd-870b71b82505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.402132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adfecf-e299-4fd1-99cd-870b71b82505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.402857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adfecf-e299-4fd1-99cd-870b71b82505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.404483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adfecf-e299-4fd1-99cd-870b71b82505 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.415292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 997/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:42.419469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.429723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb35a-e832-43e0-885a-d3a1f97f3566 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.434935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.435821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.436173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.436460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] PATH_INFO: `/v3/projects/1337a533322143f483065b05e2d28276/users/49a956bc43a742299960f66f1181908c/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.451480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1337a533322143f483065b05e2d28276, user_id=49a956bc43a742299960f66f1181908c, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.454192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.470877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1008/2005] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:42 2022] PUT /identity/v3/projects/1337a533322143f483065b05e2d28276/users/49a956bc43a742299960f66f1181908c/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:42.482787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.482787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.482787 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.538668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] MFA Rules not processed for user `49a956bc43a742299960f66f1181908c`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:42.541125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:42.652248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 998/2006] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:42.665989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:42.669873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:42.824946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6353-7b14-4ae0-a7ee-fb8001559df2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:42.829862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ef182-bbee-4649-8608-6814fd154801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:42.830009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ef182-bbee-4649-8608-6814fd154801 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:42.830293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ef182-bbee-4649-8608-6814fd154801 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:42.830571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ef182-bbee-4649-8608-6814fd154801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:42.840758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ef182-bbee-4649-8608-6814fd154801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:42.852649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ef182-bbee-4649-8608-6814fd154801 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:42.866336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1009/2007] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:52.641770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:52.860989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:53.488859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:53.549252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8039c4-f408-4ad4-a964-44d51a2b8a47 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:53.553791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:53.554652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:53.554936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:53.555215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] PATH_INFO: `/v3/users/49a956bc43a742299960f66f1181908c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:53.556483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a956bc43a742299960f66f1181908c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:53.558400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:53.617532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a956bc43a742299960f66f1181908c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:53.633149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a956bc43a742299960f66f1181908c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:53.633940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a956bc43a742299960f66f1181908c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:53.646825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a956bc43a742299960f66f1181908c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:53.665505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a956bc43a742299960f66f1181908c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:53.673191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 999/2008] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:53 2022] DELETE /identity/v3/users/49a956bc43a742299960f66f1181908c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:53.678260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:53.678680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:53.678968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:53.698938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:53.700102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:53.764758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1010/2009] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:53.774235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:53.776348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:53.848321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2e4ed-6d03-458f-b644-b062ece72523 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:53.852692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56a1f2-60cb-4837-b409-f53d77fad874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:53.853567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56a1f2-60cb-4837-b409-f53d77fad874 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:53.853851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56a1f2-60cb-4837-b409-f53d77fad874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:53.854168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56a1f2-60cb-4837-b409-f53d77fad874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:53.865875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56a1f2-60cb-4837-b409-f53d77fad874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:53.867671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56a1f2-60cb-4837-b409-f53d77fad874 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:53.878856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1000/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:54.163438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.165149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:54.178348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babaf95-450e-4546-9fc3-0472aacbe80e None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.183952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.185190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.186112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.186112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] PATH_INFO: `/v3/projects/1337a533322143f483065b05e2d28276` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.187655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1337a533322143f483065b05e2d28276)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.191360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.250655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1337a533322143f483065b05e2d28276', 'request_id': 'req-081edc32-a201-4c9f-81dd-e937983e6a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:54.256728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1337a533322143f483065b05e2d28276', 'request_id': 'req-081edc32-a201-4c9f-81dd-e937983e6a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:54.263907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1337a533322143f483065b05e2d28276', 'request_id': 'req-081edc32-a201-4c9f-81dd-e937983e6a4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:54.274098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] The token cache is being invalidate because project 1337a533322143f483065b05e2d28276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 09:59:54.274379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:54.275494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-081edc32-a201-4c9f-81dd-e937983e6a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:54.277053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1011/2011] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:54 2022] DELETE /identity/v3/projects/1337a533322143f483065b05e2d28276 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:54.281827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.282111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.282412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.300331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:54.301554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:54.319748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:54.365144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1001/2012] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:54.372983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.373276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.373560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.392357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:54.393778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:54.402453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1012/2013] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:54.406424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.415939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e181d-c52c-4a8b-a1f4-1784430eeae5 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.421972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.422914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.423270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.423784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.424725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 09:59:54.425223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.427265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.439844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1002/2014] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 09:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 09:59:54.444347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.455894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4209f-e1b1-453f-b82a-06d32d239e1c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.460709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.461376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.461660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.461937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.463637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.465537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.493288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1013/2015] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 09:59:54 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:54.497588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.507396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cae95-eb96-48cc-82ae-76cef7e58e4a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.561155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.561801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.562080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.562362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.563030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.564969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.589159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1003/2016] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 09:59:54 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 09:59:54.593447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.603920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f1df-e4a5-41de-b019-a3761163809e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.608511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.609157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.609440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.609717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.610706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.612328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.622522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1014/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 09:59:54.626293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.636973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039a14b-3a2d-4e63-811d-4ac5a6f6402a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.641667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb402f-6614-434a-b2f6-d9ba77d2e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.642316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb402f-6614-434a-b2f6-d9ba77d2e96d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.642602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb402f-6614-434a-b2f6-d9ba77d2e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.642881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb402f-6614-434a-b2f6-d9ba77d2e96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.643620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb402f-6614-434a-b2f6-d9ba77d2e96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.645231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb402f-6614-434a-b2f6-d9ba77d2e96d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.655220 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1004/2018] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 09:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 09:59:54.659164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.669479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441e179-651a-4d2a-81cb-1d215347c009 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.674087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.674965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.675250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.675529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] PATH_INFO: `/v3/projects/ef6a233104d64ecf83cf8096b859d543/users/ef689cb78f144a6f9036785b89188345/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.690293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6a233104d64ecf83cf8096b859d543, user_id=ef689cb78f144a6f9036785b89188345, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.693167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.709788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1015/2019] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 09:59:54 2022] PUT /identity/v3/projects/ef6a233104d64ecf83cf8096b859d543/users/ef689cb78f144a6f9036785b89188345/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 09:59:54.721458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.721750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.722028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.749801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] MFA Rules not processed for user `ef689cb78f144a6f9036785b89188345`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 09:59:54.751010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:54.845440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1005/2020] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 09:59:54.889547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:54.891537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:54.917502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:54.973778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fdfbf-069f-4a00-95d9-5aaca13f9a3b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:54.977593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:54.978295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:54.978575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:54.978849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:54.987639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:54.989107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:54.999936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1016/2021] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 09:59:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 09:59:59.631208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:59.632844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 09:59:59.658488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 09:59:59.706894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc879f7-ac95-44a3-bc88-c2345246bb30 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 09:59:59.711400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 09:59:59.712909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 09:59:59.713193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 09:59:59.713751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] PATH_INFO: `/v3/users/8c1def94f6364acd9da7f7e0654bc8fc` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 09:59:59.714652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1def94f6364acd9da7f7e0654bc8fc)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 09:59:59.716586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 09:59:59.762354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1def94f6364acd9da7f7e0654bc8fc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:59.773646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1def94f6364acd9da7f7e0654bc8fc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:59.774308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1def94f6364acd9da7f7e0654bc8fc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:59.781579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1def94f6364acd9da7f7e0654bc8fc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:59.788342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-80bc77cb-4489-4a68-bea0-791254907a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1def94f6364acd9da7f7e0654bc8fc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 09:59:59.794307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1006/2022] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 09:59:59 2022] DELETE /identity/v3/users/8c1def94f6364acd9da7f7e0654bc8fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 09:59:59.967709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 09:59:59.987957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2286191-43bc-4133-947a-5266f299f9cb service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.046439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.047297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.047576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.047853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] PATH_INFO: `/v3/projects/04010e51729946f19aae76a3af4a5976` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.049092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04010e51729946f19aae76a3af4a5976)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.051065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.098257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04010e51729946f19aae76a3af4a5976', 'request_id': 'req-574a9453-e6a2-41ec-9412-002e4703fa3f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:00.104955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04010e51729946f19aae76a3af4a5976', 'request_id': 'req-574a9453-e6a2-41ec-9412-002e4703fa3f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:00.112573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04010e51729946f19aae76a3af4a5976', 'request_id': 'req-574a9453-e6a2-41ec-9412-002e4703fa3f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:00.123184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] The token cache is being invalidate because project 04010e51729946f19aae76a3af4a5976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:00.123561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:00.124115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-574a9453-e6a2-41ec-9412-002e4703fa3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:00.125669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1017/2023] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 09:59:59 2022] DELETE /identity/v3/projects/04010e51729946f19aae76a3af4a5976 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:00.130776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.131066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.131347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.149511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:00.151615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:00.212952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1007/2024] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:00.220779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.221073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.221403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.240230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:00.241427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:00.249445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1018/2025] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:00.253370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.262856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04c9ea-51f0-45b3-a769-332c4decf7ca None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.267383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.268060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.268349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.268627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.269404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:00.269712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.271314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.284021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1008/2026] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:00:00.288358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.297692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30a4f0-9c13-41d3-a117-b8886320a5aa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.302326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.302967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.303247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.303519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.304248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.306675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.330444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1019/2027] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:00 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:00.334483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.344778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78907ab-7a0c-4f4f-8d84-7ae21e3c6bdb admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.364815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:00.402910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.403569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.403846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.404189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.404870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.406767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.426415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1009/2028] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:00 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:00.430624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.440936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbef05-29d2-452d-a707-2e0dca27ef1c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.445795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.446458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.447253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.447530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.448317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.449937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.460677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1020/2029] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:00.464731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.474908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7dd0-5d74-4d6a-a655-fd050044dcc0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.480446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82f1d-c852-43f2-a74e-15193c03fc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.481100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82f1d-c852-43f2-a74e-15193c03fc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.481379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82f1d-c852-43f2-a74e-15193c03fc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.481657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82f1d-c852-43f2-a74e-15193c03fc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.482373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e82f1d-c852-43f2-a74e-15193c03fc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.483954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e82f1d-c852-43f2-a74e-15193c03fc8f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.501356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1010/2030] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:00.503006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.514932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3901c-5c39-48b2-b36f-391c2ecbec90 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.519693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.520621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.521474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.521474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] PATH_INFO: `/v3/projects/a2440d811ccf4cceb1e2f4dea600b7b6/users/bb03c1f0326b4ec2ab74626720b34f7b/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.532935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:00.537950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2440d811ccf4cceb1e2f4dea600b7b6, user_id=bb03c1f0326b4ec2ab74626720b34f7b, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.541990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.555574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1021/2031] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:00 2022] PUT /identity/v3/projects/a2440d811ccf4cceb1e2f4dea600b7b6/users/bb03c1f0326b4ec2ab74626720b34f7b/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:00.565622 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.565911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.566212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.594192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] MFA Rules not processed for user `bb03c1f0326b4ec2ab74626720b34f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:00.595447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:00.657919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1011/2032] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:00.669184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.671201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:00.731548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba15c81-fc41-4268-8338-7411c5e07ba1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:00.743998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaa71d-09cb-4aa6-b410-fd5d299a2a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:00.743998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaa71d-09cb-4aa6-b410-fd5d299a2a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:00.743998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaa71d-09cb-4aa6-b410-fd5d299a2a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:00.743998 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaa71d-09cb-4aa6-b410-fd5d299a2a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:00.758864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaa71d-09cb-4aa6-b410-fd5d299a2a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:00.761304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaa71d-09cb-4aa6-b410-fd5d299a2a13 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:00.776170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1022/2033] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:00 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:00.933311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:00.934811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:01.011192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0edc6b-6c2f-4729-9db6-69834400d6f1 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:01.016013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:01.016918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.017197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.017507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] PATH_INFO: `/v3/users/4d9ed04becca4e089e621db66d46a9f9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.018884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9ed04becca4e089e621db66d46a9f9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:01.020901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:01.074769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:01.094060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9ed04becca4e089e621db66d46a9f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.113703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9ed04becca4e089e621db66d46a9f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.115185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9ed04becca4e089e621db66d46a9f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.124108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9ed04becca4e089e621db66d46a9f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.132540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9ed04becca4e089e621db66d46a9f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.139229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1012/2034] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:00 2022] DELETE /identity/v3/users/4d9ed04becca4e089e621db66d46a9f9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:01.143908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df758526-0001-493b-9efb-783f6bb98077 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.144392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df758526-0001-493b-9efb-783f6bb98077 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.144548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df758526-0001-493b-9efb-783f6bb98077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.162611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-df758526-0001-493b-9efb-783f6bb98077 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:01.164050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-df758526-0001-493b-9efb-783f6bb98077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:01.247727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1023/2035] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:01.257336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:01.258708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:01.321399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d970-bf32-4ad4-b4d9-44f3a3b40a49 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:01.325603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd501a-e618-44dd-a5f3-4f9b57c2a219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:01.326239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd501a-e618-44dd-a5f3-4f9b57c2a219 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.326517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd501a-e618-44dd-a5f3-4f9b57c2a219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.326793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd501a-e618-44dd-a5f3-4f9b57c2a219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.335786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd501a-e618-44dd-a5f3-4f9b57c2a219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:01.337920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd501a-e618-44dd-a5f3-4f9b57c2a219 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:01.347343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1013/2036] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:01.615170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df758526-0001-493b-9efb-783f6bb98077 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:01.616700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-df758526-0001-493b-9efb-783f6bb98077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:01.628796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df758526-0001-493b-9efb-783f6bb98077 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:01.633650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:01.634533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.634816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.635092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] PATH_INFO: `/v3/projects/af182e9c3d664d26b85667b9d89c6cf2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.637358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=af182e9c3d664d26b85667b9d89c6cf2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:01.639283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:01.688068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af182e9c3d664d26b85667b9d89c6cf2', 'request_id': 'req-1b4610af-5fa7-4c3f-a869-ae865622dbac'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.694118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af182e9c3d664d26b85667b9d89c6cf2', 'request_id': 'req-1b4610af-5fa7-4c3f-a869-ae865622dbac'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.701156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af182e9c3d664d26b85667b9d89c6cf2', 'request_id': 'req-1b4610af-5fa7-4c3f-a869-ae865622dbac'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.711519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] The token cache is being invalidate because project af182e9c3d664d26b85667b9d89c6cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:01.711802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.712950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-1b4610af-5fa7-4c3f-a869-ae865622dbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:01.714568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1024/2037] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:01 2022] DELETE /identity/v3/projects/af182e9c3d664d26b85667b9d89c6cf2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:01.719351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.719818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.719916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.738540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:01.739721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:01.798076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1014/2038] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:01.807472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.807758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.808070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.827280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:01.828558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:01.836778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1025/2039] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:01.840854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:01.850358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcd315-b5ad-4eeb-9336-115e79b4f196 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:01.855434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:01.856179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.856466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.856742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.857461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:01.857770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:01.859356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:01.871725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1015/2040] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:00:01.876217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:01.886765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c663a8-1db9-471b-b8f7-39ba086830fa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:01.891817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:01.892541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:01.892822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:01.893093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:01.893791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:01.896616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:01.902532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:01.927100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1026/2041] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:01 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:01.930990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:01.941662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab3e83-a6f7-4263-9938-d7df65a63f79 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:01.991570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:02.012861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:02.013714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:02.014094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:02.014462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:02.015427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:02.017540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:02.046093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1016/2042] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:01 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:02.047656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:02.072757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e6c2f-b736-4786-a0fe-7df063d16583 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:02.077468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:02.078126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:02.078406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:02.078680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:02.079410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:02.081043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:02.092233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1027/2043] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:02.096391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:02.107470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02860e3b-cb80-40c3-a887-c15088daf8a3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:02.112848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629baa1-ddd2-4d0b-94be-ee55c77d4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:02.113500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629baa1-ddd2-4d0b-94be-ee55c77d4613 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:02.113782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629baa1-ddd2-4d0b-94be-ee55c77d4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:02.114073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629baa1-ddd2-4d0b-94be-ee55c77d4613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:02.114774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629baa1-ddd2-4d0b-94be-ee55c77d4613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:02.116395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629baa1-ddd2-4d0b-94be-ee55c77d4613 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:02.127174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1017/2044] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:02.130922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:02.142286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd3852-154a-42da-9b8f-ce8407bce7fa admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:02.148667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:02.149647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:02.150621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:02.150909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] PATH_INFO: `/v3/projects/2a6a19e3a0ef4caea5b14c99843e5127/users/3ab7e185c64c45d1836b20389657d035/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:02.165948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6a19e3a0ef4caea5b14c99843e5127, user_id=3ab7e185c64c45d1836b20389657d035, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:02.168648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:02.183496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1028/2045] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:02 2022] PUT /identity/v3/projects/2a6a19e3a0ef4caea5b14c99843e5127/users/3ab7e185c64c45d1836b20389657d035/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:02.194135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:02.194366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:02.194932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:02.223962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] MFA Rules not processed for user `3ab7e185c64c45d1836b20389657d035`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:02.225206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:02.297730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1018/2046] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:02.308516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:02.310942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:02.372487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76737c2-ec87-4f86-8ab8-6eb511ba614e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:02.376338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80801-9b8d-4eb2-b413-cfc84eee7cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:02.376989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80801-9b8d-4eb2-b413-cfc84eee7cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:02.377349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80801-9b8d-4eb2-b413-cfc84eee7cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:02.377547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80801-9b8d-4eb2-b413-cfc84eee7cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:02.386601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80801-9b8d-4eb2-b413-cfc84eee7cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:02.388381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80801-9b8d-4eb2-b413-cfc84eee7cf7 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:02.398092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1029/2047] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:03.140786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:03.142224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:03.213170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f4b9-1017-48fa-8da5-dd212a0dc02c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:03.217743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:03.218613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:03.218894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:03.219171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] PATH_INFO: `/v3/users/ef689cb78f144a6f9036785b89188345` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:03.220391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef689cb78f144a6f9036785b89188345)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:03.222320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:03.268276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef689cb78f144a6f9036785b89188345'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.272728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:03.283614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef689cb78f144a6f9036785b89188345'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.284404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef689cb78f144a6f9036785b89188345'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.292145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef689cb78f144a6f9036785b89188345'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.300239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef689cb78f144a6f9036785b89188345'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.306893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1019/2048] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:03 2022] DELETE /identity/v3/users/ef689cb78f144a6f9036785b89188345 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:03.312098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:03.312601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:03.312702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:03.330642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:03.331885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:03.393332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1030/2049] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:03.403763 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:03.405236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:03.467351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b3b0f-1ff9-433c-b37c-1b8ba7a9ebca admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:03.470962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:03.471604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:03.471888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:03.472208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:03.481162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:03.482582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:03.492605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1020/2050] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:03.777050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:03.779566 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:03.802131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd037381-206f-48be-9ae1-58ef6e3bfe5b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:03.808368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:03.809401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:03.809850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:03.810331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] PATH_INFO: `/v3/projects/ef6a233104d64ecf83cf8096b859d543` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:03.811897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6a233104d64ecf83cf8096b859d543)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:03.822867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:03.882469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6a233104d64ecf83cf8096b859d543', 'request_id': 'req-84c83d24-ff7e-40e1-94fd-0c5c61da754c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.883726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:03.894123 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6a233104d64ecf83cf8096b859d543', 'request_id': 'req-84c83d24-ff7e-40e1-94fd-0c5c61da754c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.916528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6a233104d64ecf83cf8096b859d543', 'request_id': 'req-84c83d24-ff7e-40e1-94fd-0c5c61da754c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.942785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] The token cache is being invalidate because project ef6a233104d64ecf83cf8096b859d543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:03.943219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.945589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-84c83d24-ff7e-40e1-94fd-0c5c61da754c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:03.949651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1031/2051] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:03 2022] DELETE /identity/v3/projects/ef6a233104d64ecf83cf8096b859d543 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:05.550557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:05.552097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:05.564908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638999c-30e3-404e-b348-1692d8369874 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:05.640996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:05.641875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:05.642153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:05.642427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] PATH_INFO: `/v3/users/3ab7e185c64c45d1836b20389657d035` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:05.643599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab7e185c64c45d1836b20389657d035)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:05.645592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:05.691619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab7e185c64c45d1836b20389657d035'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:05.705092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab7e185c64c45d1836b20389657d035'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:05.705804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab7e185c64c45d1836b20389657d035'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:05.713230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab7e185c64c45d1836b20389657d035'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:05.714919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:05.721292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab7e185c64c45d1836b20389657d035'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:05.728804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1021/2052] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:05 2022] DELETE /identity/v3/users/3ab7e185c64c45d1836b20389657d035 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:05.733490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:05.733938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:05.734083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:05.753563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:05.755026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:05.815702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1032/2053] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:05.825538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:05.826989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:05.905143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c801ef-a84d-4379-ae5a-7612aca107ba admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:05.908871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d3f72-c4ce-4f66-a029-acb8aadf9841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:05.912101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3f72-c4ce-4f66-a029-acb8aadf9841 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:05.912445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3f72-c4ce-4f66-a029-acb8aadf9841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:05.912965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d3f72-c4ce-4f66-a029-acb8aadf9841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:05.923301 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3f72-c4ce-4f66-a029-acb8aadf9841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:05.924759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d3f72-c4ce-4f66-a029-acb8aadf9841 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:05.935808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1022/2054] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:00:06.234250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.235999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:06.250401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5042dd-ba0b-426b-ba73-8a5b8a473231 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.256515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.257387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.257664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.258016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] PATH_INFO: `/v3/projects/2a6a19e3a0ef4caea5b14c99843e5127` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.259173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6a19e3a0ef4caea5b14c99843e5127)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.261507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.310270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6a19e3a0ef4caea5b14c99843e5127', 'request_id': 'req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:06.316371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6a19e3a0ef4caea5b14c99843e5127', 'request_id': 'req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:06.323683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6a19e3a0ef4caea5b14c99843e5127', 'request_id': 'req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:06.333967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] The token cache is being invalidate because project 2a6a19e3a0ef4caea5b14c99843e5127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:06.334249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:06.334865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f6dbe0dd-7c28-4a20-9811-e95e6a60250c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:06.336417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1033/2055] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:06 2022] DELETE /identity/v3/projects/2a6a19e3a0ef4caea5b14c99843e5127 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:06.341815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.342101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.342378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.361275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:06.362574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:06.427933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1023/2056] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:06.435573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.435864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.436181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.456454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:06.457717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:06.466243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1034/2057] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:06.470364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.479954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483ecb3-2b4c-4583-9699-268fe8ce2e0b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.484589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.485300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.485851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.486125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.486853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:06.487191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.488804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.503605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1024/2058] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:00:06.505007 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.514733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314a60-b211-4aac-9774-b3e6e95ba00c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.519372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.520042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.520326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.520601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.521300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.523180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.548232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1035/2059] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:06.552552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.563122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1052-64f6-4872-8d81-27891db855d3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.622052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.622725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.623039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.623314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.624028 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.625942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.650339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1025/2060] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:06.651549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.662528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85fbdc-35c5-4970-87a4-77147acb721e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.668581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.669294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.669572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.669876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.670673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.672324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.685035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1036/2061] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:06.689476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.699839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5989e-4132-465b-a1b1-24683f80f465 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.704863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22725b-c781-4998-bd70-fc19369c88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.705518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22725b-c781-4998-bd70-fc19369c88ed admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.705795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22725b-c781-4998-bd70-fc19369c88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.706068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22725b-c781-4998-bd70-fc19369c88ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.706813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22725b-c781-4998-bd70-fc19369c88ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.708433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22725b-c781-4998-bd70-fc19369c88ed admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.714382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:06.720744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1026/2062] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:00:06.725006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.737020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924a1f1-0361-4f9a-abf8-91f42d6fb09a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.741666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.742551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.742831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.743108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] PATH_INFO: `/v3/projects/3786e149e40642bda66a55fcfa67111b/users/0e4b301437ae49c5b8e42613d7a68093/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.758673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3786e149e40642bda66a55fcfa67111b, user_id=0e4b301437ae49c5b8e42613d7a68093, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.761703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.774248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:06.781372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1037/2063] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:06 2022] PUT /identity/v3/projects/3786e149e40642bda66a55fcfa67111b/users/0e4b301437ae49c5b8e42613d7a68093/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:06.795085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.795416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.795703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.821532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] MFA Rules not processed for user `0e4b301437ae49c5b8e42613d7a68093`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:06.822801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:06.888300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1027/2064] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:06.892716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:06.952437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b3fef-9d99-48eb-bfeb-fb5132660d94 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:06.957062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:06.957704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:06.957984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:06.958315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:06.959038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:06.960967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:06.993245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1038/2065] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:06.997425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.012544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bc178-0d78-4298-ae6e-5f7ce081de21 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.069705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.070398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.070665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.070943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.071715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.073742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.099768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1028/2066] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:06 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:07.104132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.115127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa38c51-df72-43d2-a6fa-7bb91f97bf40 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.121230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.121895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.122331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.122472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.123346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.125020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.138006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1039/2067] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:07.141760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.154571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bde002-92b7-47ba-91c8-a994e8d51358 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.159877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191923-e90b-4790-8300-c77d65c19b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.160585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191923-e90b-4790-8300-c77d65c19b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.160873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191923-e90b-4790-8300-c77d65c19b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.161161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191923-e90b-4790-8300-c77d65c19b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.161889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191923-e90b-4790-8300-c77d65c19b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.163517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191923-e90b-4790-8300-c77d65c19b5f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.174448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1029/2068] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:07.178698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.189094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fe725-b493-4408-a3b2-61b6eff76610 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.193660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.203035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.203035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.203035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] PATH_INFO: `/v3/projects/4f2ce3321d354c9f9ee7f1671ec5b73b/users/1769179067a44f7f86d4bc3fa589c867/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.211411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2ce3321d354c9f9ee7f1671ec5b73b, user_id=1769179067a44f7f86d4bc3fa589c867, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.214714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.227340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1040/2069] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:07 2022] PUT /identity/v3/projects/4f2ce3321d354c9f9ee7f1671ec5b73b/users/1769179067a44f7f86d4bc3fa589c867/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:07.238312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.238635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.238938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.267909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] MFA Rules not processed for user `1769179067a44f7f86d4bc3fa589c867`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:07.269483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:07.338634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:07.345336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1030/2070] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:07.349469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.412859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865ab63-df40-40ae-b6cc-0955817e0a9e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.418557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.419221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.419508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.419789 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.420523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.422480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.449518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1041/2071] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:07 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:07.453457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.465319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcfc6-0f9d-40f8-959e-e6a3e4336470 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.534075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.534762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.535050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.535328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.536261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.538159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.562808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1031/2072] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:07 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:07.564124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.578328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5dbbd7-c3df-4494-929d-d3a5e7a23b8d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.583501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.584223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.584540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.584819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.585550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.587690 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.600000 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1042/2073] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:07.604879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.615258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7428f1-1bd6-4036-8389-21469c53c2aa admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.619966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.620887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.621180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.621464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] PATH_INFO: `/v3/projects/a7471c806e704c9396aa160968dd08b3/users/94ffd56b840742d2afbc945062a0d9db/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.637151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7471c806e704c9396aa160968dd08b3, user_id=94ffd56b840742d2afbc945062a0d9db, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.639834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.653026 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1032/2074] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:07 2022] PUT /identity/v3/projects/a7471c806e704c9396aa160968dd08b3/users/94ffd56b840742d2afbc945062a0d9db/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:07.656943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.668463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb2976-9596-4942-8faa-546a8fd2cc2b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.686150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:07.727538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b83d-83a0-4619-972f-271261cf1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.728876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b83d-83a0-4619-972f-271261cf1c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.729157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b83d-83a0-4619-972f-271261cf1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.729428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b83d-83a0-4619-972f-271261cf1c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.730145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b83d-83a0-4619-972f-271261cf1c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.731726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b83d-83a0-4619-972f-271261cf1c06 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.741523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1043/2075] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:07.745671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.755800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad34b4e-66f1-4976-b9c9-1e0102b8fcdb admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.760519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.761397 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.761685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.761964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] PATH_INFO: `/v3/projects/a7471c806e704c9396aa160968dd08b3/users/94ffd56b840742d2afbc945062a0d9db/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.763934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7471c806e704c9396aa160968dd08b3, user_id=94ffd56b840742d2afbc945062a0d9db, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:07.766597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:07.777795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1033/2076] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:07 2022] PUT /identity/v3/projects/a7471c806e704c9396aa160968dd08b3/users/94ffd56b840742d2afbc945062a0d9db/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:07.788901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.789285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.789623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:07.816212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] MFA Rules not processed for user `94ffd56b840742d2afbc945062a0d9db`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:07.817412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:07.892194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1044/2077] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:07.904766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:07.906540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:07.969126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca87bdd-02fa-46d4-b269-7cba1e3741d0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:07.972828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:07.973482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:07.973782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:07.974074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:08.031497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:08.033032 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:08.042035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1034/2078] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:09.554912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:09.556483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:09.569046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ff4ff-725e-47e4-a759-93b23e7b3447 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:09.572651 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:09.573293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:09.573575 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:09.573851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:09.636318 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:09.637804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:09.647881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1045/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:10.201691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:10.207908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:10.211503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44b70e-8537-4100-b981-dcf9fcc9aa15 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:10.216860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdb786-8a40-4786-91b4-e36867b6418c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:10.217584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdb786-8a40-4786-91b4-e36867b6418c service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:10.218051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdb786-8a40-4786-91b4-e36867b6418c service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:10.218497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdb786-8a40-4786-91b4-e36867b6418c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:10.227894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdb786-8a40-4786-91b4-e36867b6418c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:10.229492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbdb786-8a40-4786-91b4-e36867b6418c service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:10.239421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1035/2080] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:10.425461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:10.426856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:10.475063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:10.496022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfc5e4-798f-41ee-b713-ea7aa413c12e service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:10.500578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:10.501441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:10.501714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:10.501982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] PATH_INFO: `/v3/users/bb03c1f0326b4ec2ab74626720b34f7b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:10.503159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb03c1f0326b4ec2ab74626720b34f7b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:10.505096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:10.553460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb03c1f0326b4ec2ab74626720b34f7b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:10.566658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb03c1f0326b4ec2ab74626720b34f7b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:10.574095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb03c1f0326b4ec2ab74626720b34f7b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:10.581946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb03c1f0326b4ec2ab74626720b34f7b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:10.583272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb03c1f0326b4ec2ab74626720b34f7b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:10.592769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1046/2081] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:10 2022] DELETE /identity/v3/users/bb03c1f0326b4ec2ab74626720b34f7b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:10.597652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:10.598248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:10.598627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:10.618910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:10.620479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:10.688415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1036/2082] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:10.698686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:10.700599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:10.772748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ba8c8-a043-4439-916d-e056c1c9595c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:10.776960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c9a9-82e9-4394-89eb-3f3ddeb7efda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:10.777620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c9a9-82e9-4394-89eb-3f3ddeb7efda service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:10.777917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c9a9-82e9-4394-89eb-3f3ddeb7efda service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:10.778198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c9a9-82e9-4394-89eb-3f3ddeb7efda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:10.787497 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c9a9-82e9-4394-89eb-3f3ddeb7efda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:10.789048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e420c9a9-82e9-4394-89eb-3f3ddeb7efda service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:10.799878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1047/2083] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:11.069078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.070789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:11.084815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d110296-b4d3-4361-ba7b-3e05d7586a18 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.092894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.094801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.095241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.095719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] PATH_INFO: `/v3/projects/a2440d811ccf4cceb1e2f4dea600b7b6` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.097479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2440d811ccf4cceb1e2f4dea600b7b6)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.101915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.158294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2440d811ccf4cceb1e2f4dea600b7b6', 'request_id': 'req-684d76ff-2176-4dda-9a9b-6a8a21753908'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:11.164410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2440d811ccf4cceb1e2f4dea600b7b6', 'request_id': 'req-684d76ff-2176-4dda-9a9b-6a8a21753908'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:11.172247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2440d811ccf4cceb1e2f4dea600b7b6', 'request_id': 'req-684d76ff-2176-4dda-9a9b-6a8a21753908'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:11.182781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] The token cache is being invalidate because project a2440d811ccf4cceb1e2f4dea600b7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:11.183070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:11.183693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-684d76ff-2176-4dda-9a9b-6a8a21753908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:11.185277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1037/2084] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:11 2022] DELETE /identity/v3/projects/a2440d811ccf4cceb1e2f4dea600b7b6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:11.190135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.190373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.190652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.208368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:11.209865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:11.269831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1048/2085] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:11.277728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.278211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.278330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.296632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:11.297841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:11.307563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1038/2086] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:11.311767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.317824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:11.322968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b2db2-fb1e-4dae-a9f9-526b6d7ccac0 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.329466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.330384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.330859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.331136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.331888 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:11.332226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.333843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.346004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1049/2087] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:00:11.350117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.359484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df6fad-c72d-4ef5-bfe1-0d2f53e86c29 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.364501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.365149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.365432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.365705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.366387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.368392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.395576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1039/2088] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:11.399810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.410862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277953e-5ee2-416a-8e1c-9b252f315052 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.468419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.469082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.469366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.469644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.470337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.472389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.494688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1050/2089] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:11.500148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.513019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7f462-59fc-4ad0-a908-a89a91552fd8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.517844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.518500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.518780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.519051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.519777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.521679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.538281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1040/2090] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:11.543152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.553845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3c92-6348-435f-9926-9f6deb3bc27f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.559647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5cc5-0dfc-42c4-8cab-0be2121da69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.560585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5cc5-0dfc-42c4-8cab-0be2121da69b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.560938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5cc5-0dfc-42c4-8cab-0be2121da69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.561279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5cc5-0dfc-42c4-8cab-0be2121da69b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.562146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5cc5-0dfc-42c4-8cab-0be2121da69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.563874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5cc5-0dfc-42c4-8cab-0be2121da69b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.574927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1051/2091] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:11.579923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.591813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549602b8-e8fc-4c04-8a59-6ffc0dc9b646 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.598474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.599657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.600187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.600653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] PATH_INFO: `/v3/projects/4ac1bd1301e348b3aeac30e1848e1827/users/fb2ab0ffbea345ea8bfc87462f95c568/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.622176 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac1bd1301e348b3aeac30e1848e1827, user_id=fb2ab0ffbea345ea8bfc87462f95c568, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.625318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.647486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1041/2092] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:11 2022] PUT /identity/v3/projects/4ac1bd1301e348b3aeac30e1848e1827/users/fb2ab0ffbea345ea8bfc87462f95c568/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:11.657026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.657238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.657516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.684822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] MFA Rules not processed for user `fb2ab0ffbea345ea8bfc87462f95c568`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:11.686052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:11.751341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1052/2093] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:11.755880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.772245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:11.829096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a8ea4-a3ee-4069-ab84-19b897b31e30 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.833860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.834371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.834651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.834930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.835682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.838197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.866140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1042/2094] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:11.867543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.878422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988ac7a-4160-4013-a5c9-c3e00e59b05f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.942189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.943006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.943364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.943718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.944610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.947422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:11.955373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:11.972909 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1053/2095] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:11 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:11.974139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:11.984819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70693a28-6488-45fa-8ddf-6d21f5718e51 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:11.990227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:11.991334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:11.991625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:11.991904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:11.992679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:11.994820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:12.007517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1043/2096] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:12.012140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:12.022681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26402ee8-f8f0-400b-b87b-5ef3d9838d19 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:12.027499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:12.028461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:12.028751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:12.029031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] PATH_INFO: `/v3/projects/eaa81b1c60eb4812875a99442c18efa7/users/3f306690576d4faab445412559a772dd/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:12.044835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa81b1c60eb4812875a99442c18efa7, user_id=3f306690576d4faab445412559a772dd, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:12.047541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:12.062863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1054/2097] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:12 2022] PUT /identity/v3/projects/eaa81b1c60eb4812875a99442c18efa7/users/3f306690576d4faab445412559a772dd/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:12.067063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:12.078316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ff41b-cb30-48d8-90b2-031c02ab1aa9 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:12.141464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f717e74-a527-447a-936b-b26734951c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:12.142134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717e74-a527-447a-936b-b26734951c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:12.142416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717e74-a527-447a-936b-b26734951c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:12.142687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f717e74-a527-447a-936b-b26734951c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:12.143420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717e74-a527-447a-936b-b26734951c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:12.145544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f717e74-a527-447a-936b-b26734951c08 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:12.156793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1044/2098] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:12.161258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:12.172339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bd2af-6314-4e2f-9d7d-384d3fafc46a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:12.177204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:12.178186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:12.178537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:12.178878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] PATH_INFO: `/v3/projects/eaa81b1c60eb4812875a99442c18efa7/users/3f306690576d4faab445412559a772dd/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:12.181498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa81b1c60eb4812875a99442c18efa7, user_id=3f306690576d4faab445412559a772dd, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:12.184308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:12.205454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1055/2099] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:12 2022] PUT /identity/v3/projects/eaa81b1c60eb4812875a99442c18efa7/users/3f306690576d4faab445412559a772dd/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:12.209076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:12.209446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:12.209828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:12.238498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] MFA Rules not processed for user `3f306690576d4faab445412559a772dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:12.239732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:12.311467 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1045/2100] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:12.322745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:12.324530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:12.380816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34c6fc-cda9-47b7-91cb-a837735a66eb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:12.385094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:12.385963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:12.386194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:12.386271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:12.399831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:12.401323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:12.412215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1056/2101] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:12.458760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:12.460188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:12.471864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e8182-f83b-4652-9b15-bbe264c1c541 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:12.475502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe153d-0410-4cc3-bc36-3fc1440d0e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:12.476165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe153d-0410-4cc3-bc36-3fc1440d0e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:12.476447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe153d-0410-4cc3-bc36-3fc1440d0e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:12.476720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe153d-0410-4cc3-bc36-3fc1440d0e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:12.481582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:12.536253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe153d-0410-4cc3-bc36-3fc1440d0e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:12.537696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe153d-0410-4cc3-bc36-3fc1440d0e0b service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:12.547134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1046/2102] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:14.173529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:14.174953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:14.245643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d15cf-f378-4f0c-8eb0-f6765ca0442a service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:14.251125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:14.252006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:14.252291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:14.252568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] PATH_INFO: `/v3/users/0e4b301437ae49c5b8e42613d7a68093` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:14.253745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4b301437ae49c5b8e42613d7a68093)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:14.256018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:14.305181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4b301437ae49c5b8e42613d7a68093'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.313713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:14.320927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4b301437ae49c5b8e42613d7a68093'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.329437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4b301437ae49c5b8e42613d7a68093'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.336371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4b301437ae49c5b8e42613d7a68093'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.336997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4b301437ae49c5b8e42613d7a68093'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.343323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1057/2103] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:14 2022] DELETE /identity/v3/users/0e4b301437ae49c5b8e42613d7a68093 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:14.348295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:14.348769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:14.348975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:14.367261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:14.368564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:14.432168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1047/2104] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:14.442247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:14.443724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:14.509406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b97689-8114-45a1-aa75-6d385f6ca72d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:14.513112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:14.513766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:14.514169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:14.514518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:14.524125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:14.526086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:14.536074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1058/2105] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:14.900444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:14.902306 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:14.925234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e154b1-3d0a-4548-bb48-74a9070fc6d9 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:14.930413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:14.931338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:14.931617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:14.931893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] PATH_INFO: `/v3/projects/3786e149e40642bda66a55fcfa67111b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:14.933173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3786e149e40642bda66a55fcfa67111b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:14.935040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:14.984493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3786e149e40642bda66a55fcfa67111b', 'request_id': 'req-f243d663-dd61-47b6-9cd4-6482c9044dd3'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.991093 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3786e149e40642bda66a55fcfa67111b', 'request_id': 'req-f243d663-dd61-47b6-9cd4-6482c9044dd3'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:14.999573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3786e149e40642bda66a55fcfa67111b', 'request_id': 'req-f243d663-dd61-47b6-9cd4-6482c9044dd3'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.012501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] The token cache is being invalidate because project 3786e149e40642bda66a55fcfa67111b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:15.012786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.013427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.015002 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1048/2106] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:14 2022] DELETE /identity/v3/projects/3786e149e40642bda66a55fcfa67111b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:15.019011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:15.028509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb62df-7f20-4619-8c65-9d49f018a8cc service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:15.090794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:15.090794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:15.090794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:15.090794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] PATH_INFO: `/v3/users/1769179067a44f7f86d4bc3fa589c867` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:15.091113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1769179067a44f7f86d4bc3fa589c867)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:15.092580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:15.146753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1769179067a44f7f86d4bc3fa589c867'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.158239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1769179067a44f7f86d4bc3fa589c867'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.165664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1769179067a44f7f86d4bc3fa589c867'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.170952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:15.173145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1769179067a44f7f86d4bc3fa589c867'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.174063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1769179067a44f7f86d4bc3fa589c867'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.182378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1059/2107] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:15 2022] DELETE /identity/v3/users/1769179067a44f7f86d4bc3fa589c867 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:15.447101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:15.448583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:15.461583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d663-dd61-47b6-9cd4-6482c9044dd3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:15.488922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:15.522569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:15.523427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:15.523710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:15.523997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] PATH_INFO: `/v3/projects/4f2ce3321d354c9f9ee7f1671ec5b73b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:15.525216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2ce3321d354c9f9ee7f1671ec5b73b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:15.527158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:15.571816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2ce3321d354c9f9ee7f1671ec5b73b', 'request_id': 'req-ba453099-adb0-452c-a05f-4be92efa96fe'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.577794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2ce3321d354c9f9ee7f1671ec5b73b', 'request_id': 'req-ba453099-adb0-452c-a05f-4be92efa96fe'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.584821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2ce3321d354c9f9ee7f1671ec5b73b', 'request_id': 'req-ba453099-adb0-452c-a05f-4be92efa96fe'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.595385 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] The token cache is being invalidate because project 4f2ce3321d354c9f9ee7f1671ec5b73b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:15.595696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.596337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.597838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1049/2108] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:15 2022] DELETE /identity/v3/projects/4f2ce3321d354c9f9ee7f1671ec5b73b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:15.601780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:15.603673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:15.616626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa321d1-22fe-49f8-a9fd-de039d5136a7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:15.671419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:15.672652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:15.672942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:15.673217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] PATH_INFO: `/v3/users/94ffd56b840742d2afbc945062a0d9db` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:15.674384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ffd56b840742d2afbc945062a0d9db)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:15.676329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:15.722739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ffd56b840742d2afbc945062a0d9db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.735580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ffd56b840742d2afbc945062a0d9db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.744999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ffd56b840742d2afbc945062a0d9db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.752473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ffd56b840742d2afbc945062a0d9db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.753288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ffd56b840742d2afbc945062a0d9db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:15.760258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1060/2109] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:15 2022] DELETE /identity/v3/users/94ffd56b840742d2afbc945062a0d9db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:15.884695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:15.886195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:15.901739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba453099-adb0-452c-a05f-4be92efa96fe admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:15.977429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:15.979112 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:15.979397 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:15.979672 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] PATH_INFO: `/v3/users/fb2ab0ffbea345ea8bfc87462f95c568` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:15.981165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2ab0ffbea345ea8bfc87462f95c568)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:15.982863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.043438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2ab0ffbea345ea8bfc87462f95c568'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.054829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:16.058390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2ab0ffbea345ea8bfc87462f95c568'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.059834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.060719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2ab0ffbea345ea8bfc87462f95c568'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.061703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.070880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2ab0ffbea345ea8bfc87462f95c568'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.081073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-36507b21-78d1-4d63-bcd5-c70817f51c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2ab0ffbea345ea8bfc87462f95c568'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.085153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183620c-1c1a-478a-967f-280f97b1eeee admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.093091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.094065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.094437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.094865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] PATH_INFO: `/v3/projects/a7471c806e704c9396aa160968dd08b3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.096006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7471c806e704c9396aa160968dd08b3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.097974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.102621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1050/2110] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:15 2022] DELETE /identity/v3/users/fb2ab0ffbea345ea8bfc87462f95c568 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:16.107275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.107588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.108232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.126508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:16.127876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.151180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7471c806e704c9396aa160968dd08b3', 'request_id': 'req-dc278e73-fb48-49fb-904d-2817265ccf3f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.157837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7471c806e704c9396aa160968dd08b3', 'request_id': 'req-dc278e73-fb48-49fb-904d-2817265ccf3f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.167327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7471c806e704c9396aa160968dd08b3', 'request_id': 'req-dc278e73-fb48-49fb-904d-2817265ccf3f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.174783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:16.181734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] The token cache is being invalidate because project a7471c806e704c9396aa160968dd08b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:16.182582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.183372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dc278e73-fb48-49fb-904d-2817265ccf3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.188670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1061/2111] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:16 2022] DELETE /identity/v3/projects/a7471c806e704c9396aa160968dd08b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:16.190880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b7b9f-d832-4533-88b1-94dacfe08a31 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.191500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b7b9f-d832-4533-88b1-94dacfe08a31 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.191966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b7b9f-d832-4533-88b1-94dacfe08a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.204824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1051/2112] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:16.214991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.216589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.218184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e52b7b9f-d832-4533-88b1-94dacfe08a31 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:16.219446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e52b7b9f-d832-4533-88b1-94dacfe08a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.281202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa8b4d-09f5-4d83-b0b7-a26406ec050e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.285688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1062/2113] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:16.294809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.295095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.295375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.314058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:16.315614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.326177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1063/2114] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:16.331436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.336627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.338154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.338616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.339038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.341348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa0821-d829-4a2c-97bc-866991884eb5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.345934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.346585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.346864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.347141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.347863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:16.348199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.349790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.350963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.352427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.361982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1064/2115] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:00:16.363027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1052/2116] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:16.365975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.375883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea3545-dab1-4a47-8684-8fe7e3c421f5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.381921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.383358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.383708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.384608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.385737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.388117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.420222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1065/2117] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:16 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:16.424842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.435804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8a8a8-c5bb-484a-b23f-44d5275d57f5 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.489149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:16.548348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.548348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.548348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.548348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.548888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.550436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.573552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1053/2118] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:16 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:16.577540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.591380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9ebf6-3dc7-4f9e-b25e-ae429c7a54f5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.597779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.598620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.598906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.599276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.600067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.601934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.613550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1066/2119] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:00:16.617824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.627936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86963ea2-f7b5-47fb-b64c-7f4a56c7d8cd admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.632916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.633645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.633987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.634366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.635138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.636792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.651720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1054/2120] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:16.652876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.663818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8502c2-c654-4abc-a8df-cc984f6b90b6 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.669484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459a31-7bcf-4d04-b289-9b5f8f9f81e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.670508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459a31-7bcf-4d04-b289-9b5f8f9f81e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.670794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459a31-7bcf-4d04-b289-9b5f8f9f81e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.671070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459a31-7bcf-4d04-b289-9b5f8f9f81e9 admin admin] PATH_INFO: `/v3/projects/8918c8442bf64ad28ea153a36b194f8a/users/dc1444d1ccf94601a11be7ed6f643798/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.677854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.679659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.690934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459a31-7bcf-4d04-b289-9b5f8f9f81e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8918c8442bf64ad28ea153a36b194f8a, user_id=dc1444d1ccf94601a11be7ed6f643798, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.693600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459a31-7bcf-4d04-b289-9b5f8f9f81e9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.696117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b8f8-b047-4939-9a6c-e536003a7c58 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.702735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.704061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.704623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.704916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] PATH_INFO: `/v3/projects/4ac1bd1301e348b3aeac30e1848e1827` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.706314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac1bd1301e348b3aeac30e1848e1827)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.708541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.710179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1067/2121] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:16 2022] PUT /identity/v3/projects/8918c8442bf64ad28ea153a36b194f8a/users/dc1444d1ccf94601a11be7ed6f643798/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:16.715700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.716069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.716377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.734811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:16.736243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.758719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac1bd1301e348b3aeac30e1848e1827', 'request_id': 'req-9ddcfcea-456b-4178-a18c-249ac1953a0c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.765298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac1bd1301e348b3aeac30e1848e1827', 'request_id': 'req-9ddcfcea-456b-4178-a18c-249ac1953a0c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.772759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac1bd1301e348b3aeac30e1848e1827', 'request_id': 'req-9ddcfcea-456b-4178-a18c-249ac1953a0c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.783778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] The token cache is being invalidate because project 4ac1bd1301e348b3aeac30e1848e1827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:16.784101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.784758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.786338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1055/2122] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:16 2022] DELETE /identity/v3/projects/4ac1bd1301e348b3aeac30e1848e1827 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:16.790038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.791933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.797411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1068/2123] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:16.806871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:16.808200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:16.834988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:16.857185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfcea-456b-4178-a18c-249ac1953a0c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.862099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.862963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.863243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.863518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] PATH_INFO: `/v3/users/3f306690576d4faab445412559a772dd` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.864713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f306690576d4faab445412559a772dd)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.866633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.868218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bfb737-70ac-4c82-81c3-c09874f241ae None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:16.911038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:16.917118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f306690576d4faab445412559a772dd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.920890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:16.921576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:16.921859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:16.922149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:16.930632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f306690576d4faab445412559a772dd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.931180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:16.931670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f306690576d4faab445412559a772dd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.932665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:16.938507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f306690576d4faab445412559a772dd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.942037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1069/2124] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:00:16.948294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae9b9d6a-0fb8-40c7-8a26-b59f4f83ea6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f306690576d4faab445412559a772dd'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:16.954660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1056/2125] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:16 2022] DELETE /identity/v3/users/3f306690576d4faab445412559a772dd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:17.347209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.358654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32508add-8b1a-446b-922a-49b46655060b service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.424275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.425253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.425606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.425947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] PATH_INFO: `/v3/projects/eaa81b1c60eb4812875a99442c18efa7` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.427220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa81b1c60eb4812875a99442c18efa7)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:17.429280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:17.476322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa81b1c60eb4812875a99442c18efa7', 'request_id': 'req-565a91bc-7c9c-4adb-b4e1-910c31da37f5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:17.482489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa81b1c60eb4812875a99442c18efa7', 'request_id': 'req-565a91bc-7c9c-4adb-b4e1-910c31da37f5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:17.490183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa81b1c60eb4812875a99442c18efa7', 'request_id': 'req-565a91bc-7c9c-4adb-b4e1-910c31da37f5'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:17.502332 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] The token cache is being invalidate because project eaa81b1c60eb4812875a99442c18efa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:17.502663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:17.503409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-565a91bc-7c9c-4adb-b4e1-910c31da37f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:17.505136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1070/2126] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:17 2022] DELETE /identity/v3/projects/eaa81b1c60eb4812875a99442c18efa7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:17.510756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2702f7-07e3-46c4-b85b-64c3400df464 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.511226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2702f7-07e3-46c4-b85b-64c3400df464 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.511316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2702f7-07e3-46c4-b85b-64c3400df464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.531210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ab2702f7-07e3-46c4-b85b-64c3400df464 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:17.532472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ab2702f7-07e3-46c4-b85b-64c3400df464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:17.621525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.621824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.622151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.628159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1057/2127] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:17.638468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.638750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.639080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.645567 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:17.655956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] MFA Rules not processed for user `dc1444d1ccf94601a11be7ed6f643798`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:17.658578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:17.667129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:17.668605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:17.678962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1058/2128] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:17.683646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.694868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f867557-9eaa-4024-8959-7c662cd7c426 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.702714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.703515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.703808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.704134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.705287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:17.705762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:17.707538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:17.725919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1059/2129] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:00:17.731171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.747244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4f04-b213-4807-abc5-c0b93ed1bab0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.753983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.754710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.755094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.755497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.756309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:17.758291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:17.776162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1071/2130] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:17.789794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.794905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:17.798906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1060/2131] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:17 2022] POST /identity/v3/projects => generated 409 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:17.803145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.887312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4f0c-e2c8-4142-9b1c-85e640059280 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.890604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb8e4-e3e0-4c11-8228-09601f4c17ef admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.896352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.896833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.897142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.897446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.898183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:17.900446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:17.921432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1061/2132] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:17 2022] POST /identity/v3/users => generated 305 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:17.925442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.935703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce6c82-b9dc-423e-8025-6f94f7bb3f0f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.940407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.940556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccb108-c599-45e3-b7bb-70b8164bc807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.941054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.941207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb108-c599-45e3-b7bb-70b8164bc807 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.941391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.941491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb108-c599-45e3-b7bb-70b8164bc807 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.941638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.941731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccb108-c599-45e3-b7bb-70b8164bc807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.942426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:17.943897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:17.946690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:17.957462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1062/2133] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:00:17.960994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:17.973459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa935a-c91a-4f3a-ab79-45866588fe44 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:17.978757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:17.979406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:17.979688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:17.979992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:17.980714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:17.982296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:17.994390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1063/2134] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:00:17.998519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.003574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccb108-c599-45e3-b7bb-70b8164bc807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.005128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccb108-c599-45e3-b7bb-70b8164bc807 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.008264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e670600-44a5-4be7-80b8-d700e5abf556 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.013213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.014419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.014419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.014611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1072/2135] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:00:18.014689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] PATH_INFO: `/v3/projects/6421a981b0864f4da627afc100dfee6a/users/3b76fcc5d3924bd9af0bcfffb267f42f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.032749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6421a981b0864f4da627afc100dfee6a, user_id=3b76fcc5d3924bd9af0bcfffb267f42f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.035392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.049414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1064/2136] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:17 2022] PUT /identity/v3/projects/6421a981b0864f4da627afc100dfee6a/users/3b76fcc5d3924bd9af0bcfffb267f42f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:18.060054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.060346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.060626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.078748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:18.088868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] MFA Rules not processed for user `3b76fcc5d3924bd9af0bcfffb267f42f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:18.090154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:18.167141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1073/2137] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:18.168520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.232977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82d28-16cb-47d3-932b-345c03d25bb5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.239005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.239788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.240151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.240496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.241287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.243380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.276816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1065/2138] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:18 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:18.280546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.295965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c22e4b-df01-4bc1-9c88-cb4e1b944260 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.366236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.366956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.367238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.367521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.368349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.370378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.391581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1074/2139] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:18 2022] POST /identity/v3/users => generated 310 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:18.395212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.406492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30400bbe-9074-49df-bd62-ba430e34f571 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.411131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.411785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.412102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.412378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.413107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.414705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.429307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1066/2140] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:18.430659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.440705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f3c5-f752-4de2-921b-840dd0a16723 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.445570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.446456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.447313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.447590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] PATH_INFO: `/v3/projects/e82972c02679454ca904c27d99238fe9/users/49806b7d5c1740aaa935b2ee6aa9db29/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.464353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82972c02679454ca904c27d99238fe9, user_id=49806b7d5c1740aaa935b2ee6aa9db29, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.466969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.480211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1075/2141] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:18 2022] PUT /identity/v3/projects/e82972c02679454ca904c27d99238fe9/users/49806b7d5c1740aaa935b2ee6aa9db29/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:18.484363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.494335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538570-6a11-49f7-85c1-82e61a2c8c9e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.549407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fb9d5-d1ea-4a92-a0bc-da6f1c3f2666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.549989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fb9d5-d1ea-4a92-a0bc-da6f1c3f2666 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.550270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fb9d5-d1ea-4a92-a0bc-da6f1c3f2666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.550550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fb9d5-d1ea-4a92-a0bc-da6f1c3f2666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.551277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fb9d5-d1ea-4a92-a0bc-da6f1c3f2666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.552898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fb9d5-d1ea-4a92-a0bc-da6f1c3f2666 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.562595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1067/2142] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:18.566709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.577251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc8308-5608-42e3-8d47-dd50f94e2105 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.581737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.582607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.582887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.583168 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] PATH_INFO: `/v3/projects/e82972c02679454ca904c27d99238fe9/users/49806b7d5c1740aaa935b2ee6aa9db29/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.585116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e82972c02679454ca904c27d99238fe9, user_id=49806b7d5c1740aaa935b2ee6aa9db29, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.588420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.598382 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1076/2143] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:18 2022] PUT /identity/v3/projects/e82972c02679454ca904c27d99238fe9/users/49806b7d5c1740aaa935b2ee6aa9db29/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:18.609662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.609954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.610246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.636668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] MFA Rules not processed for user `49806b7d5c1740aaa935b2ee6aa9db29`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:18.637890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:18.657880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:18.706081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1068/2144] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:18 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:18.717721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.773182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d6607-a03a-4c97-825e-81be9455afc0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.777020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54611468-3f23-4ba5-a4aa-44225e074dd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.777656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611468-3f23-4ba5-a4aa-44225e074dd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.777940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611468-3f23-4ba5-a4aa-44225e074dd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.778216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54611468-3f23-4ba5-a4aa-44225e074dd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:18.785119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:18.787475 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54611468-3f23-4ba5-a4aa-44225e074dd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:18.789420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54611468-3f23-4ba5-a4aa-44225e074dd6 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:18.799696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1077/2145] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:18 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:18.950541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:18.959794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61816be-ac21-4835-a3b1-e3969675d40c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:18.963336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:18.963967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:18.964280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:18.964558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:19.021020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:19.022455 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:19.031282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1069/2146] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:21.474450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a148de-cb65-4773-83ba-5698865d370f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:21.475296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a148de-cb65-4773-83ba-5698865d370f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:21.475296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a148de-cb65-4773-83ba-5698865d370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:21.493005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-01a148de-cb65-4773-83ba-5698865d370f None None] MFA Rules not processed for user `dc1444d1ccf94601a11be7ed6f643798`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:21.494327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01a148de-cb65-4773-83ba-5698865d370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:21.549774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1078/2147] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:28.649818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:28.651279 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:28.722419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8ef0-a329-4d68-9dc4-1a7f2573f241 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:28.727054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:28.727948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:28.728290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:28.728603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] PATH_INFO: `/v3/users/ab492b1fc2994405a6ae3a4b61338518` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:28.729880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab492b1fc2994405a6ae3a4b61338518)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:28.731796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:28.778208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab492b1fc2994405a6ae3a4b61338518'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:28.785257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:28.791040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab492b1fc2994405a6ae3a4b61338518'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:28.791797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab492b1fc2994405a6ae3a4b61338518'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:28.798987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab492b1fc2994405a6ae3a4b61338518'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:28.806868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab492b1fc2994405a6ae3a4b61338518'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:28.812957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1070/2148] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:28 2022] DELETE /identity/v3/users/ab492b1fc2994405a6ae3a4b61338518 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:28.817420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:28.817900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:28.818138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:28.836486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:28.837707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:28.899442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1079/2149] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:28.910507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:28.911877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:28.968604 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612dcf4-6f7f-40ad-bff3-99a3b6fbd176 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:28.972159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff26299-f331-4e04-9630-ccba84b98b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:28.972808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff26299-f331-4e04-9630-ccba84b98b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:28.973090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff26299-f331-4e04-9630-ccba84b98b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:28.973366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff26299-f331-4e04-9630-ccba84b98b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:28.983094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff26299-f331-4e04-9630-ccba84b98b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:28.984556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff26299-f331-4e04-9630-ccba84b98b4f service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:28.995695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1071/2150] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:29.346912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.348479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.377023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0d27-7c6d-44fa-8768-581b2f2f0be7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.383778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.384734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.385022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.385305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] PATH_INFO: `/v3/projects/067cf95468f849dc838fff22972630b1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.386494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] RBAC: Authorizing `identity:delete_project(project_id=067cf95468f849dc838fff22972630b1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.388436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.459521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067cf95468f849dc838fff22972630b1', 'request_id': 'req-ff534e50-88cc-4ac5-af99-64e6a26f522f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.467331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067cf95468f849dc838fff22972630b1', 'request_id': 'req-ff534e50-88cc-4ac5-af99-64e6a26f522f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.476702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067cf95468f849dc838fff22972630b1', 'request_id': 'req-ff534e50-88cc-4ac5-af99-64e6a26f522f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.489082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] The token cache is being invalidate because project 067cf95468f849dc838fff22972630b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:29.489082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.489739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.491300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1080/2151] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:29 2022] DELETE /identity/v3/projects/067cf95468f849dc838fff22972630b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:29.497511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5dbd8-579d-4eb1-893c-c0d3277f4600 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.497825 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5dbd8-579d-4eb1-893c-c0d3277f4600 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.498100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5dbd8-579d-4eb1-893c-c0d3277f4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.499969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.501368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.517575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fdf5dbd8-579d-4eb1-893c-c0d3277f4600 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:29.518849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fdf5dbd8-579d-4eb1-893c-c0d3277f4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.529509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:29.572178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff534e50-88cc-4ac5-af99-64e6a26f522f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.576849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.577723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.578081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.578320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] PATH_INFO: `/v3/users/3b76fcc5d3924bd9af0bcfffb267f42f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.579611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b76fcc5d3924bd9af0bcfffb267f42f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.581558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.582051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1072/2152] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:29.590300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.590590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.590866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.610109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:29.612499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.621663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1073/2153] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:29.625810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.629185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b76fcc5d3924bd9af0bcfffb267f42f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.636332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967091ab-c98d-479e-b296-3c53a8d52798 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.641137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.641782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.642067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.642342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.642476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b76fcc5d3924bd9af0bcfffb267f42f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.643074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:29.643411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.645040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.650308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b76fcc5d3924bd9af0bcfffb267f42f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.657272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b76fcc5d3924bd9af0bcfffb267f42f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.657709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1074/2154] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:00:29.658237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3dc711da-d4b0-4f1b-a614-0297c28063a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b76fcc5d3924bd9af0bcfffb267f42f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:29.662118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.663811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.664473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1081/2155] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:29 2022] DELETE /identity/v3/users/3b76fcc5d3924bd9af0bcfffb267f42f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:29.669028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.669384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.669730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.678070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0475efa9-b6ec-4076-9cc3-43ba0518b966 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.688005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:29.689306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.730315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:29.737711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.738731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.739243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.739533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.740462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.742450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.751251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1082/2156] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:29.761060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.762500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:29.773778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1075/2157] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:29 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:29.775057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.807772 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:29.819144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d23b8-9bfb-4ccb-a4b1-a6fcaaaa84f4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.835364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5292a88-dfd1-4e5f-b1fb-38752714003c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.840374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.841005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.841320 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.841594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.842276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.844357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.869839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1076/2158] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:29 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:29.870873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.873202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.873851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.874137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.874411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.880300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4853b02-b9e1-4cdf-b86e-b7640f90a5c6 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.883668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.885106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.885231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.885743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.886025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.886305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.887031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.888659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.894699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1083/2159] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:29.898884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1077/2160] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:29.903876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.914517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd80f4e-aba8-49b4-a080-b1d383a315e7 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.920096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec963b9f-545f-41a8-9ff5-13cd88a4a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.920767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963b9f-545f-41a8-9ff5-13cd88a4a8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.921055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963b9f-545f-41a8-9ff5-13cd88a4a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.921335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec963b9f-545f-41a8-9ff5-13cd88a4a8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.922063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963b9f-545f-41a8-9ff5-13cd88a4a8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.923717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec963b9f-545f-41a8-9ff5-13cd88a4a8e4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:29.935099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1084/2161] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:29.939491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:29.955764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab63b2-32f2-4003-9991-488bbc4a5c6e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:29.961560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:29.962686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:29.963049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:29.963399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] PATH_INFO: `/v3/projects/705097e0a13f400d820a4e6c6720c101/users/cd37e2b041ae441fb1c1ae1d77570820/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:29.981132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=705097e0a13f400d820a4e6c6720c101, user_id=cd37e2b041ae441fb1c1ae1d77570820, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:29.983814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:30.004562 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1078/2162] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:29 2022] PUT /identity/v3/projects/705097e0a13f400d820a4e6c6720c101/users/cd37e2b041ae441fb1c1ae1d77570820/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:30.011432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:30.011931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:30.012400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:30.033399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:30.034661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:30.107348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1085/2163] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:30.117124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:30.176392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db9252-4f9b-41ae-9598-c61dd281f19e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:30.180261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:30.180975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:30.181254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:30.181526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:30.191161 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:30.193097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:30.203578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1079/2164] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:30.233135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:30.234657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:30.255290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f2928-441c-4cbf-bfb7-5f46cd15ff2c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:30.260374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:30.261413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:30.261712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:30.262041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] PATH_INFO: `/v3/projects/6421a981b0864f4da627afc100dfee6a` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:30.263269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6421a981b0864f4da627afc100dfee6a)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:30.265266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:30.314852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6421a981b0864f4da627afc100dfee6a', 'request_id': 'req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.321709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6421a981b0864f4da627afc100dfee6a', 'request_id': 'req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.330363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6421a981b0864f4da627afc100dfee6a', 'request_id': 'req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.341949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] The token cache is being invalidate because project 6421a981b0864f4da627afc100dfee6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:30.342241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.342898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.344603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1086/2165] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:30 2022] DELETE /identity/v3/projects/6421a981b0864f4da627afc100dfee6a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:30.349063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:30.359489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded9523-e098-4621-bf51-79af5f3158e9 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:30.404868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:30.430073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:30.431904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:30.432226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:30.432494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] PATH_INFO: `/v3/users/49806b7d5c1740aaa935b2ee6aa9db29` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:30.433719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49806b7d5c1740aaa935b2ee6aa9db29)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:30.435638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:30.495135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49806b7d5c1740aaa935b2ee6aa9db29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.511105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49806b7d5c1740aaa935b2ee6aa9db29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.512700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49806b7d5c1740aaa935b2ee6aa9db29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.521641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49806b7d5c1740aaa935b2ee6aa9db29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.529900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6b2783e-da5c-44d9-9bba-2d6c14b1090f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49806b7d5c1740aaa935b2ee6aa9db29'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:30.537124 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1080/2166] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:30 2022] DELETE /identity/v3/users/49806b7d5c1740aaa935b2ee6aa9db29 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:31.568300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:31.569778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:31.583003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93a9c-3c3c-4a40-99f4-a4baa9a34d4b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:31.594314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:31.656329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:31.657351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:31.658181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:31.658181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] PATH_INFO: `/v3/projects/e82972c02679454ca904c27d99238fe9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:31.659675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e82972c02679454ca904c27d99238fe9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:31.661585 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:31.725729 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e82972c02679454ca904c27d99238fe9', 'request_id': 'req-505487d9-fc48-4951-a12e-452dca7b2b04'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:31.736312 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e82972c02679454ca904c27d99238fe9', 'request_id': 'req-505487d9-fc48-4951-a12e-452dca7b2b04'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:31.745640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e82972c02679454ca904c27d99238fe9', 'request_id': 'req-505487d9-fc48-4951-a12e-452dca7b2b04'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:31.773751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] The token cache is being invalidate because project e82972c02679454ca904c27d99238fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:31.773960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:31.777344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-505487d9-fc48-4951-a12e-452dca7b2b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:31.780557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1087/2167] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:31 2022] DELETE /identity/v3/projects/e82972c02679454ca904c27d99238fe9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:31.785893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:31.786398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:31.786488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:31.807355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:31.808785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:31.877066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1081/2168] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:31.885360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:31.885659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:31.885940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:31.909543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:31.910871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:31.920572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1088/2169] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:31.924816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:31.940251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6510681-0f92-4890-ae04-fca2929bd709 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:31.948061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:31.948829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:31.949110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:31.949384 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:31.950116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:31.950445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:31.952064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:31.964222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1082/2170] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:00:31.968849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:31.978485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f32e5-c987-4db3-bd16-d9c9a704d66d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:31.984936 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:31.985602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:31.985882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:31.986407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:31.987103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:31.989059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:32.022389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1089/2171] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:31 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:32.023621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:32.035082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f13a5-5761-4cbb-89c2-1f29dc943be5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:32.103853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:32.108572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:32.110194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:32.111228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:32.111520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:32.112248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:32.114843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:32.141270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1083/2172] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:32 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:32.145143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:32.157770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a975-f576-41a4-a551-5afdda2e6481 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:32.162510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:32.163375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:32.163685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:32.164140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:32.166450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:32.168103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:32.184371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1090/2173] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:32.189271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:32.201944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589022a6-2fd9-4ed9-b8c9-86e983d48792 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:32.208053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f67f9-4f23-4fd1-96b8-8e135d2620c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:32.209450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f67f9-4f23-4fd1-96b8-8e135d2620c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:32.209746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f67f9-4f23-4fd1-96b8-8e135d2620c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:32.210030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f67f9-4f23-4fd1-96b8-8e135d2620c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:32.210786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f67f9-4f23-4fd1-96b8-8e135d2620c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:32.213242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f67f9-4f23-4fd1-96b8-8e135d2620c1 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:32.238490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1084/2174] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:32.239716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:32.251501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb12995-efc9-47a1-a819-4ce2108302bd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:32.256555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:32.258021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:32.258378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:32.258727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] PATH_INFO: `/v3/projects/7b5666c60ac6409bb36a9a5891433bda/users/448da2ce415d41cfb2c1c7918e685bf1/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:32.277648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5666c60ac6409bb36a9a5891433bda, user_id=448da2ce415d41cfb2c1c7918e685bf1, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:32.280542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:32.302758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1091/2175] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:32 2022] PUT /identity/v3/projects/7b5666c60ac6409bb36a9a5891433bda/users/448da2ce415d41cfb2c1c7918e685bf1/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:32.307881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42108ab-fb8a-4883-a033-ab60f6e5d3e9 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:32.308207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42108ab-fb8a-4883-a033-ab60f6e5d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:32.308491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42108ab-fb8a-4883-a033-ab60f6e5d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:32.327762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f42108ab-fb8a-4883-a033-ab60f6e5d3e9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:32.328933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f42108ab-fb8a-4883-a033-ab60f6e5d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:32.406471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1085/2176] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:32.417308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:32.420238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:32.490288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:32.505868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6043a-456c-42b1-8548-41ef8c9fee39 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:32.510392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:32.511274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:32.511563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:32.512370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:32.522862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:32.525167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:32.536325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1092/2177] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:33.487417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:33.487938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:33.488213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:33.524820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] MFA Rules not processed for user `448da2ce415d41cfb2c1c7918e685bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:33.526127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:33.637120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1086/2178] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:33.641593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:33.653685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983b1e7-a225-498e-9369-6c1762b58ded service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:33.658661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:33.659329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:33.659639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:33.659876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:33.660598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:33.662504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:33.703373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1093/2179] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:33 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:33.707294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:33.719065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67baab4-7628-47c3-9ea6-d4d5c843a829 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:33.780065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:33.788970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:33.790873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:33.791403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:33.791624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:33.792474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:33.794828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:33.821757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1087/2180] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:33 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:33.823169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:33.835669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3fe86-aeaf-4823-91e0-92ef95b8411f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:33.841074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:33.841744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:33.842023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:33.842298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:33.843028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:33.844649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:33.856620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1094/2181] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:33.861447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:33.874302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad07319-c80b-4004-b3c2-9adcc1bf3072 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:33.879998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:33.880266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:33.880422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:33.880831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] PATH_INFO: `/v3/projects/e2ec5333c79f48b0840972c984af2537/users/b74b2d46d4fc404d93962dad99424081/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:33.898936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ec5333c79f48b0840972c984af2537, user_id=b74b2d46d4fc404d93962dad99424081, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:33.901665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:33.921348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:33.921784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1088/2182] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:33 2022] PUT /identity/v3/projects/e2ec5333c79f48b0840972c984af2537/users/b74b2d46d4fc404d93962dad99424081/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:33.935568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1848e4a-1668-4a77-920a-1b56496a983a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:34.033929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ac704-ebfa-4ebd-836c-ef5da4d703be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:34.034883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac704-ebfa-4ebd-836c-ef5da4d703be admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:34.035314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac704-ebfa-4ebd-836c-ef5da4d703be admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:34.035737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ac704-ebfa-4ebd-836c-ef5da4d703be admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:34.036720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ac704-ebfa-4ebd-836c-ef5da4d703be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:34.038496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ac704-ebfa-4ebd-836c-ef5da4d703be admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:34.054745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1095/2183] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:34.056392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:34.070645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796649d-9e89-4108-b85f-50a9c80f1085 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:34.078313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:34.079420 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:34.079848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:34.080488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] PATH_INFO: `/v3/projects/e2ec5333c79f48b0840972c984af2537/users/b74b2d46d4fc404d93962dad99424081/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:34.083275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ec5333c79f48b0840972c984af2537, user_id=b74b2d46d4fc404d93962dad99424081, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:34.105691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:34.123052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1089/2184] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:34 2022] PUT /identity/v3/projects/e2ec5333c79f48b0840972c984af2537/users/b74b2d46d4fc404d93962dad99424081/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:35.444106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5259-5053-48f3-a4b6-b0ad5988e293 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:35.444656 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5259-5053-48f3-a4b6-b0ad5988e293 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:35.444739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea5259-5053-48f3-a4b6-b0ad5988e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:35.502348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-83ea5259-5053-48f3-a4b6-b0ad5988e293 None None] MFA Rules not processed for user `b74b2d46d4fc404d93962dad99424081`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:35.503453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-83ea5259-5053-48f3-a4b6-b0ad5988e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:35.622532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1096/2185] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:35.643175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:35.645290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:35.719317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79d9e8-0814-43a5-9577-c476d8cb3767 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:35.723625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:35.724261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:35.724542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:35.724815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:35.803435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:35.805260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:35.824331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1090/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:36.228512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:36.229015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:36.229885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:36.289740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] MFA Rules not processed for user `cd37e2b041ae441fb1c1ae1d77570820`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:36.292381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:36.335710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:36.406148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1097/2187] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:36.410973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:36.412695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:36.507833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b19e1b-c2f5-4895-b427-39809d3ff884 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:36.521843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:36.522577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:36.522982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:36.523159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:36.523832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:36.534363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:36.541510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:36.579202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1091/2188] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:36 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:00:36.583359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:36.599002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8ee6-b374-452d-a899-14f682374739 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:36.672008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:36.673762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:36.674414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:36.675116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:36.676661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:36.679839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:36.721579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1098/2189] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:36 2022] POST /identity/v3/users => generated 297 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:36.722594 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:36.748488 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6492d-b5fc-44fe-b631-e1f620fd24a8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:36.755164 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:36.756264 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:36.757693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:36.757693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:36.758260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:36.761153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:36.785191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1092/2190] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:36.788198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:36.813403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b72b-daf2-4f70-bcf4-c5d2d2a63e58 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:36.819138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:36.820357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:36.820637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:36.820911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] PATH_INFO: `/v3/projects/80c7f6a2b4a546de8dd1d9c5457d81e7/users/568f5a3bc85845c5b3423a93dc9676c4/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:36.841105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c7f6a2b4a546de8dd1d9c5457d81e7, user_id=568f5a3bc85845c5b3423a93dc9676c4, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:36.843820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:36.862464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1099/2191] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:36 2022] PUT /identity/v3/projects/80c7f6a2b4a546de8dd1d9c5457d81e7/users/568f5a3bc85845c5b3423a93dc9676c4/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:36.866595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:36.878159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489de25-9705-45e9-b13d-99231ca90e2e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:36.971059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:36.971886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:36.972265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:36.972609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:36.973580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:36.975229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:36.987239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1093/2192] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:36.991309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:37.004171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888be26-94c4-4745-8ebc-94099906c074 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:37.009228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c292fff-76b5-448d-b543-4b3431af0437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:37.010255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c292fff-76b5-448d-b543-4b3431af0437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:37.010657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c292fff-76b5-448d-b543-4b3431af0437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:37.011025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c292fff-76b5-448d-b543-4b3431af0437 admin admin] PATH_INFO: `/v3/projects/80c7f6a2b4a546de8dd1d9c5457d81e7/users/568f5a3bc85845c5b3423a93dc9676c4/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:37.013209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c292fff-76b5-448d-b543-4b3431af0437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c7f6a2b4a546de8dd1d9c5457d81e7, user_id=568f5a3bc85845c5b3423a93dc9676c4, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:37.015965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c292fff-76b5-448d-b543-4b3431af0437 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:37.029914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1100/2193] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:36 2022] PUT /identity/v3/projects/80c7f6a2b4a546de8dd1d9c5457d81e7/users/568f5a3bc85845c5b3423a93dc9676c4/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:37.367111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:37.443089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845aca-6754-4bed-b98c-7ba2b13aa3dc admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:37.528337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978c236-4a45-4310-bf54-ec71a6c318ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:37.528995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c236-4a45-4310-bf54-ec71a6c318ec service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:37.529280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c236-4a45-4310-bf54-ec71a6c318ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:37.529545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978c236-4a45-4310-bf54-ec71a6c318ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:37.619416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:37.650280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978c236-4a45-4310-bf54-ec71a6c318ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:37.652041 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978c236-4a45-4310-bf54-ec71a6c318ec service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:37.672664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1094/2194] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:38.351029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:38.351029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:38.351518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:38.381440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] MFA Rules not processed for user `7e98533664dd4bf6b90e471fc42ba41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:38.382922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:38.454455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1101/2195] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:45.485704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb768b4-5940-455e-a44a-5c122d180f75 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:45.486478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb768b4-5940-455e-a44a-5c122d180f75 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:45.486728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb768b4-5940-455e-a44a-5c122d180f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:45.527920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-dcb768b4-5940-455e-a44a-5c122d180f75 None None] MFA Rules not processed for user `568f5a3bc85845c5b3423a93dc9676c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:45.529525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-dcb768b4-5940-455e-a44a-5c122d180f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:45.694406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1095/2196] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:45.702583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:45.704200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:45.739101 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:45.822825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bd58d-076c-4c1c-9b2b-09fe9502afb7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:45.828744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:45.829849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:45.830334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:45.830973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:45.982601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:45.984726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:46.021444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1102/2197] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:46.200889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f77d50-aad0-4a6f-8042-bd1898a3a410 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:46.201531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f77d50-aad0-4a6f-8042-bd1898a3a410 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:46.201822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f77d50-aad0-4a6f-8042-bd1898a3a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:46.220413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-41f77d50-aad0-4a6f-8042-bd1898a3a410 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:46.221733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-41f77d50-aad0-4a6f-8042-bd1898a3a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:46.287846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1096/2198] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:00:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:46.337809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:46.339217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:46.414377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8164b-5447-4dbf-824e-a995e3ad36b1 service glance] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:46.419859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:46.420532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:46.420811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:46.421090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:46.429054 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:46.431262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:46.439324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1103/2199] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:00:52.287829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:52.288437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:52.288437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:52.310089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] MFA Rules not processed for user `d3d76c556b5f41f19c1a2a466a031cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:52.311389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:52.393354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1097/2200] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:54.005149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:54.084096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436b016-59ab-4483-9bcc-f0bed8a89b48 service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:54.093423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:54.094890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:54.095389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:54.095935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] PATH_INFO: `/v3/users/448da2ce415d41cfb2c1c7918e685bf1` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:54.097816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=448da2ce415d41cfb2c1c7918e685bf1)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:54.103243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:54.108907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:54.158867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448da2ce415d41cfb2c1c7918e685bf1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.172242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448da2ce415d41cfb2c1c7918e685bf1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.181297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448da2ce415d41cfb2c1c7918e685bf1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.193091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448da2ce415d41cfb2c1c7918e685bf1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.196832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448da2ce415d41cfb2c1c7918e685bf1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.207965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1104/2201] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:54 2022] DELETE /identity/v3/users/448da2ce415d41cfb2c1c7918e685bf1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:54.420455 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:54.451057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76383b09-be15-4979-9771-64ad28b06ad0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:54.478038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:54.550309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:54.551199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:54.552482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:54.554046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] PATH_INFO: `/v3/projects/7b5666c60ac6409bb36a9a5891433bda` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:54.557144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5666c60ac6409bb36a9a5891433bda)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:54.559080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:54.642589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5666c60ac6409bb36a9a5891433bda', 'request_id': 'req-5120be15-fb15-46ec-9d19-3f5c39799d38'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.650079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5666c60ac6409bb36a9a5891433bda', 'request_id': 'req-5120be15-fb15-46ec-9d19-3f5c39799d38'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.661388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5666c60ac6409bb36a9a5891433bda', 'request_id': 'req-5120be15-fb15-46ec-9d19-3f5c39799d38'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.675907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] The token cache is being invalidate because project 7b5666c60ac6409bb36a9a5891433bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:54.676152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.676877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.678468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1098/2202] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:54 2022] DELETE /identity/v3/projects/7b5666c60ac6409bb36a9a5891433bda => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:54.683260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:54.685009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:54.699835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d311df-16f6-42d4-bc35-2c73e6cf0fbc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:54.781340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:54.782381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:54.782726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:54.783069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] PATH_INFO: `/v3/users/b74b2d46d4fc404d93962dad99424081` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:54.784393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74b2d46d4fc404d93962dad99424081)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:54.788458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:54.869800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74b2d46d4fc404d93962dad99424081'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.885796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74b2d46d4fc404d93962dad99424081'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.895628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74b2d46d4fc404d93962dad99424081'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.910667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74b2d46d4fc404d93962dad99424081'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.911665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0d965528-eef5-4980-bf1c-c939b10ac434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74b2d46d4fc404d93962dad99424081'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:54.919268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1105/2203] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:00:54 2022] DELETE /identity/v3/users/b74b2d46d4fc404d93962dad99424081 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:55.145533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.147274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:55.178206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120be15-fb15-46ec-9d19-3f5c39799d38 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.255996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.256929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.257327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.257702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] PATH_INFO: `/v3/projects/e2ec5333c79f48b0840972c984af2537` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.259166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ec5333c79f48b0840972c984af2537)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.261292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.321709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:55.325453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ec5333c79f48b0840972c984af2537', 'request_id': 'req-2fdfb730-6f83-4c83-9d01-379506298c1a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:55.336646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ec5333c79f48b0840972c984af2537', 'request_id': 'req-2fdfb730-6f83-4c83-9d01-379506298c1a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:55.348066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ec5333c79f48b0840972c984af2537', 'request_id': 'req-2fdfb730-6f83-4c83-9d01-379506298c1a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:55.359943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] The token cache is being invalidate because project e2ec5333c79f48b0840972c984af2537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:00:55.360263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:55.360903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2fdfb730-6f83-4c83-9d01-379506298c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:00:55.367254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1099/2204] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:00:55 2022] DELETE /identity/v3/projects/e2ec5333c79f48b0840972c984af2537 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:00:55.369110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.369563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.369705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.378490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:55.394481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:55.395739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:55.470826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1106/2205] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:55.480030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.480574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.480728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.500958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:55.502308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:55.511699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1100/2206] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:00:55.515857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.526696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb262f6-0664-4e4b-92a7-055f5ed06671 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.531504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.532206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.532495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.532776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.533514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:00:55.533887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.535628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.548784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1107/2207] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:00:55.553014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.571078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912cfb5-b94e-466d-b17c-4580e032143e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.576428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.577094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.577379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.577661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.578356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.580747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.613232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1101/2208] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:00:55 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:55.617389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.642621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545a001-e6f8-42e2-a694-01b7cf68f6ac admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.747938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.748680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.748964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.749243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.749941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.752203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.785919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1108/2209] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:00:55 2022] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:00:55.790400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.801462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3468dc-2f9c-4d8a-b5ef-aff273a5c9e8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.806748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.807492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.807778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.808092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.808907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.810497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.823500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1102/2210] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:00:55.829844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.839179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f7dfa-98ad-45ef-b9cd-6050c32b08c1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.846359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa7861-43fc-4c52-86d3-8f378067242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.846359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa7861-43fc-4c52-86d3-8f378067242e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.846657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa7861-43fc-4c52-86d3-8f378067242e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.846748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa7861-43fc-4c52-86d3-8f378067242e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.847417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa7861-43fc-4c52-86d3-8f378067242e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.849192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa7861-43fc-4c52-86d3-8f378067242e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.864711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:55.870515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1109/2211] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:00:55.875850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334e29-42bc-4922-af83-b0a0d633cb66 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:55.880832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:55.881791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.882138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.882468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] PATH_INFO: `/v3/projects/7691859ee26e4a63b5f604661457a357/users/623efb15ff4348ea984c09554b8ad3c2/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.901845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7691859ee26e4a63b5f604661457a357, user_id=623efb15ff4348ea984c09554b8ad3c2, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:55.905140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:55.924689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1103/2212] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:00:55 2022] PUT /identity/v3/projects/7691859ee26e4a63b5f604661457a357/users/623efb15ff4348ea984c09554b8ad3c2/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:00:55.938177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3efa4-0896-40e4-8f5a-939235352fa5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:55.938469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3efa4-0896-40e4-8f5a-939235352fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:55.938804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3efa4-0896-40e4-8f5a-939235352fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:55.969178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8ac3efa4-0896-40e4-8f5a-939235352fa5 None None] MFA Rules not processed for user `623efb15ff4348ea984c09554b8ad3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:55.970669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8ac3efa4-0896-40e4-8f5a-939235352fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:56.047323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:00:56.055185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1110/2213] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:00:56.070611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:00:56.072690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:56.149754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0acf1-6b9e-43d4-995f-43f2846b07c7 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:00:56.152597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b782b-da16-4364-a80e-4b09c9fb7510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:00:56.153380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b782b-da16-4364-a80e-4b09c9fb7510 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:56.153764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b782b-da16-4364-a80e-4b09c9fb7510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:56.154143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b782b-da16-4364-a80e-4b09c9fb7510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:56.167820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b782b-da16-4364-a80e-4b09c9fb7510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:00:56.169630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b782b-da16-4364-a80e-4b09c9fb7510 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:00:56.206057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1104/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:00:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:00:58.215003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:00:58.215604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:00:58.215604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:00:58.233254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] MFA Rules not processed for user `cd37e2b041ae441fb1c1ae1d77570820`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:00:58.234401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:00:58.318341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1111/2215] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:00:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:01.628814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466cd7a-2e32-4bdf-8530-16475dd1c04d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:01.629362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466cd7a-2e32-4bdf-8530-16475dd1c04d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:01.629362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466cd7a-2e32-4bdf-8530-16475dd1c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:01.654022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6466cd7a-2e32-4bdf-8530-16475dd1c04d None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:01.656390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6466cd7a-2e32-4bdf-8530-16475dd1c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:01.766258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1105/2216] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:01:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:01.788894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:01.791059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:01.925750 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f17d7-8448-48c5-8639-a28563ddd27b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:01.931451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:01.932162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:01.932573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:01.932813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:01.959883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:01.963164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:01.990523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1112/2217] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:01:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:01:11.756422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=4,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:11.981657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=58 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:22.064792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325472c-b134-475c-aaaf-e5147e5b7a8d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:22.065380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325472c-b134-475c-aaaf-e5147e5b7a8d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:22.065380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325472c-b134-475c-aaaf-e5147e5b7a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:22.108941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e325472c-b134-475c-aaaf-e5147e5b7a8d None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:22.110174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e325472c-b134-475c-aaaf-e5147e5b7a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:22.141100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1106/2218] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:01:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:22.153551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:22.200072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304ecd-fbec-4958-9bb7-2c040bb31825 service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:22.207733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19918530-c366-4bef-9291-a9b6e70e1230 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:22.208426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19918530-c366-4bef-9291-a9b6e70e1230 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:22.208705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19918530-c366-4bef-9291-a9b6e70e1230 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:22.208980 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19918530-c366-4bef-9291-a9b6e70e1230 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:22.218467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19918530-c366-4bef-9291-a9b6e70e1230 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:22.220078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19918530-c366-4bef-9291-a9b6e70e1230 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:22.228091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1113/2219] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:01:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:01:32.138968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=20 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:32.224881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=20 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:45.445293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339505e4-5632-4502-8804-79e2efeabf3d None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:45.445978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339505e4-5632-4502-8804-79e2efeabf3d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:45.445978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339505e4-5632-4502-8804-79e2efeabf3d None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:45.447130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1107/2220] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 10:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:01:45.453735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acf92-435f-4471-b6ca-8f3ea26509ea None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:45.454205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acf92-435f-4471-b6ca-8f3ea26509ea None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:45.454428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377acf92-435f-4471-b6ca-8f3ea26509ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:45.519477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-377acf92-435f-4471-b6ca-8f3ea26509ea None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:45.521004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-377acf92-435f-4471-b6ca-8f3ea26509ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:45.613977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1114/2221] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 10:01:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:01:45.625686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339505e4-5632-4502-8804-79e2efeabf3d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:45.628174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-339505e4-5632-4502-8804-79e2efeabf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:45.688575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339505e4-5632-4502-8804-79e2efeabf3d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:45.692649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222c414-4a7b-482a-b566-24e99232282a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:45.693296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c414-4a7b-482a-b566-24e99232282a service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:45.693580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c414-4a7b-482a-b566-24e99232282a service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:45.693862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222c414-4a7b-482a-b566-24e99232282a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:45.705502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222c414-4a7b-482a-b566-24e99232282a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:45.706819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222c414-4a7b-482a-b566-24e99232282a service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:45.718181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1108/2222] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:01:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:01:45.785454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbfc38-c6cd-4717-b9f1-8945f31a4026 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:45.785750 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbfc38-c6cd-4717-b9f1-8945f31a4026 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:45.786037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbfc38-c6cd-4717-b9f1-8945f31a4026 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:45.788944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1115/2223] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 10:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:01:45.793629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6359b-5853-456e-b2ba-ba2e3ede5c07 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:45.793917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6359b-5853-456e-b2ba-ba2e3ede5c07 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:45.794197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6359b-5853-456e-b2ba-ba2e3ede5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:45.826599 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-36c6359b-5853-456e-b2ba-ba2e3ede5c07 None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:45.827830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-36c6359b-5853-456e-b2ba-ba2e3ede5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:45.890880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1109/2224] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 10:01:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:45.904198 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbfc38-c6cd-4717-b9f1-8945f31a4026 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:45.908862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5fcbfc38-c6cd-4717-b9f1-8945f31a4026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:45.923604 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbfc38-c6cd-4717-b9f1-8945f31a4026 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:45.927537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd9b2b-4314-4a29-a0c2-d620be7e5f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:45.928213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9b2b-4314-4a29-a0c2-d620be7e5f50 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:45.928500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9b2b-4314-4a29-a0c2-d620be7e5f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:45.928783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd9b2b-4314-4a29-a0c2-d620be7e5f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:45.938916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9b2b-4314-4a29-a0c2-d620be7e5f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:45.941105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd9b2b-4314-4a29-a0c2-d620be7e5f50 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:45.952688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1116/2225] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:01:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:01:46.035669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd87ac-9e8a-4275-879b-56e7b3426365 None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:46.036024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd87ac-9e8a-4275-879b-56e7b3426365 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:46.036290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd87ac-9e8a-4275-879b-56e7b3426365 None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:46.037761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1110/2226] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 10:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:01:46.042698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:46.042986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:46.043281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:46.061730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:46.062828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:46.072072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1117/2227] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 10:01:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:46.083419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd87ac-9e8a-4275-879b-56e7b3426365 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:46.085380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-08dd87ac-9e8a-4275-879b-56e7b3426365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:46.108270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd87ac-9e8a-4275-879b-56e7b3426365 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:46.112049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86601db0-6256-4a40-bd7f-15a0cc5b4fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:46.112940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601db0-6256-4a40-bd7f-15a0cc5b4fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:46.113219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601db0-6256-4a40-bd7f-15a0cc5b4fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:46.113494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86601db0-6256-4a40-bd7f-15a0cc5b4fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:46.124473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601db0-6256-4a40-bd7f-15a0cc5b4fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:46.125938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86601db0-6256-4a40-bd7f-15a0cc5b4fb7 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:46.136463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1111/2228] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:01:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:01:47.425539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:47.503955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe0fcb-a643-4cdf-b2de-16b238008200 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:47.508470 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:47.509325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:47.509601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:47.509872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] PATH_INFO: `/v3/users/623efb15ff4348ea984c09554b8ad3c2` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:47.511659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623efb15ff4348ea984c09554b8ad3c2)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:47.513596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:47.518723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:47.557855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623efb15ff4348ea984c09554b8ad3c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:47.569396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623efb15ff4348ea984c09554b8ad3c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:47.577009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623efb15ff4348ea984c09554b8ad3c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:47.583635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623efb15ff4348ea984c09554b8ad3c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:47.584297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623efb15ff4348ea984c09554b8ad3c2'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:47.590065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1118/2229] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:01:47 2022] DELETE /identity/v3/users/623efb15ff4348ea984c09554b8ad3c2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:01:47.595996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:47.596459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:47.596551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:47.635287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:47.636524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:47.695067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1112/2230] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:47.704487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:47.705914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:47.762630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6054b-677c-40a3-a426-4321842ae630 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:47.766248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66e143-0c7b-4c87-93a2-82342f1a2827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:47.766882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66e143-0c7b-4c87-93a2-82342f1a2827 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:47.767187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66e143-0c7b-4c87-93a2-82342f1a2827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:47.767454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66e143-0c7b-4c87-93a2-82342f1a2827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:47.776345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66e143-0c7b-4c87-93a2-82342f1a2827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:47.777776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc66e143-0c7b-4c87-93a2-82342f1a2827 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:47.787416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1119/2231] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:01:48.100291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.101938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:48.109651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:48.115204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbb8a8-8c27-4a2c-9ff9-62303b8c8418 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.120076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.121001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.121285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.121678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] PATH_INFO: `/v3/projects/7691859ee26e4a63b5f604661457a357` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.122864 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7691859ee26e4a63b5f604661457a357)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.124788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.185382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7691859ee26e4a63b5f604661457a357', 'request_id': 'req-8d39136c-4589-4fe0-b894-38e04d1ef71a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:48.191833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7691859ee26e4a63b5f604661457a357', 'request_id': 'req-8d39136c-4589-4fe0-b894-38e04d1ef71a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:48.200116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7691859ee26e4a63b5f604661457a357', 'request_id': 'req-8d39136c-4589-4fe0-b894-38e04d1ef71a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:48.211241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] The token cache is being invalidate because project 7691859ee26e4a63b5f604661457a357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:01:48.211658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:48.212506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8d39136c-4589-4fe0-b894-38e04d1ef71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:01:48.214675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1113/2232] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:01:48 2022] DELETE /identity/v3/projects/7691859ee26e4a63b5f604661457a357 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:01:48.219498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.219816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.220143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.256996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:48.258169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:48.314096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1120/2233] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:48.321898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.322189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.322988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.341902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:48.343099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:48.351193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1114/2234] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:48.355232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.365199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd62f11-a00f-41a5-89ef-741d7ded934b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.369806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.370455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.370741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.371048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.371776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:01:48.372122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.373719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.382008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:48.387822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1121/2235] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:01:48.390422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.399667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c257cd-5962-41bf-adb4-c379d9f6558c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.404413 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.405056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.405340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.405615 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.406297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.408211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.433550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1115/2236] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:01:48 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:01:48.437498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.447422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6304fd2-57f4-4f7c-95b8-f432f7e62fa1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.502258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.502911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.503191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.503468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.504178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.506086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.525474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1122/2237] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:01:48 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:01:48.529476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.539590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7107def-bc73-4c14-8e8a-3cd48c1e4f64 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.545024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.545668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.545949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.546223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.546950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.548565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.559381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1116/2238] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:01:48.563083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.572733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc062-367b-45ac-ba02-959ad7b5675a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.577311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd130e-2279-4773-b94a-3b7e3e38819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.577947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd130e-2279-4773-b94a-3b7e3e38819d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.578226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd130e-2279-4773-b94a-3b7e3e38819d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.578500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd130e-2279-4773-b94a-3b7e3e38819d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.579218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd130e-2279-4773-b94a-3b7e3e38819d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.580826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd130e-2279-4773-b94a-3b7e3e38819d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.590353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1123/2239] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:01:48.594025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.604237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f5f5-0cee-4760-beaa-c51ed439f159 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.608769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.609627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.609905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.610180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] PATH_INFO: `/v3/projects/e01114ffee3f4b56a38d8dba6e771b0e/users/5c65d640886e4cd58acc6462d6a637ee/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.626366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e01114ffee3f4b56a38d8dba6e771b0e, user_id=5c65d640886e4cd58acc6462d6a637ee, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.629089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.641742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1117/2240] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:01:48 2022] PUT /identity/v3/projects/e01114ffee3f4b56a38d8dba6e771b0e/users/5c65d640886e4cd58acc6462d6a637ee/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:01:48.652631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.652920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.653202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.679487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] MFA Rules not processed for user `5c65d640886e4cd58acc6462d6a637ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:01:48.680749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:48.744727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1124/2241] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:01:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:01:48.755485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:48.757212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:48.832163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd0066-2cc2-4991-817c-7a20fbe6d478 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:48.835801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:48.836462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:48.836747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:48.837023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:48.845784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:48.847200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:48.857839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1118/2242] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:01:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:01:54.824768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:01:54.826269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:54.883221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85743c-959b-419b-9b3b-608fe891bbe5 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:01:54.886776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:01:54.887411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:01:54.887691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:01:54.887964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:01:54.889787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:01:54.912071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:01:54.952548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:01:54.953972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbbcd4-833f-49e6-929b-cf0e6d7b3e72 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:01:54.963497 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1125/2243] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:01:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:01:58.851934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:04.366738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:04.368399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:04.459131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a204f-b765-44fc-8052-4cce1645da10 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:04.464486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:04.465130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:04.465409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:04.465686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:04.468078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:04.479234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:04.480837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:04.491438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1119/2244] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:02:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:02:04.959144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=19 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:06.756106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:06.756669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:06.756669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:06.803301 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:06.804515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:06.870222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1126/2245] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:06.893428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:06.894817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:06.989378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f0384-d2f2-497b-9b13-56d966e42646 service placement] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:06.995116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff17a6a-452f-40e6-9ac2-2ef20cd60a9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:06.996988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17a6a-452f-40e6-9ac2-2ef20cd60a9c service swift] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:06.997287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17a6a-452f-40e6-9ac2-2ef20cd60a9c service swift] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:06.997606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff17a6a-452f-40e6-9ac2-2ef20cd60a9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:07.006778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17a6a-452f-40e6-9ac2-2ef20cd60a9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:07.008392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff17a6a-452f-40e6-9ac2-2ef20cd60a9c service swift] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:07.023440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1120/2246] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:02:11.434887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:11.498983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6d1b0-db4e-40ee-8515-20baa0db7cda None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:11.503876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:11.504913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:11.505261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:11.505542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] PATH_INFO: `/v3/users/5c65d640886e4cd58acc6462d6a637ee` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:11.507121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c65d640886e4cd58acc6462d6a637ee)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:11.509400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:11.562197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c65d640886e4cd58acc6462d6a637ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:11.589223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c65d640886e4cd58acc6462d6a637ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:11.602205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c65d640886e4cd58acc6462d6a637ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:11.604776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:11.611565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c65d640886e4cd58acc6462d6a637ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:11.612996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c65d640886e4cd58acc6462d6a637ee'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:11.622741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1127/2247] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:02:11 2022] DELETE /identity/v3/users/5c65d640886e4cd58acc6462d6a637ee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:02:11.625137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:11.625794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:11.625794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:11.655455 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:11.657704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:11.693971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:11.721513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1121/2248] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:11.731420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:11.733030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:11.796968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bf81-f6dd-4570-a849-d0d3887af481 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:11.801075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b37c3-6aba-401b-b680-cc78d09f5eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:11.802185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b37c3-6aba-401b-b680-cc78d09f5eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:11.802457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b37c3-6aba-401b-b680-cc78d09f5eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:11.802815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b37c3-6aba-401b-b680-cc78d09f5eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:11.813839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b37c3-6aba-401b-b680-cc78d09f5eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:11.815310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b37c3-6aba-401b-b680-cc78d09f5eb4 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:11.825350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1128/2249] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:02:12.216561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.219351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:12.254933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fe69c-a030-483b-a66b-e8ed1446630c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.259656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.260638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.260925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.261327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] PATH_INFO: `/v3/projects/e01114ffee3f4b56a38d8dba6e771b0e` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.262595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e01114ffee3f4b56a38d8dba6e771b0e)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.264588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.322969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e01114ffee3f4b56a38d8dba6e771b0e', 'request_id': 'req-b0c9badc-b092-48e0-9766-4e8e51458589'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:12.329861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e01114ffee3f4b56a38d8dba6e771b0e', 'request_id': 'req-b0c9badc-b092-48e0-9766-4e8e51458589'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:12.339352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e01114ffee3f4b56a38d8dba6e771b0e', 'request_id': 'req-b0c9badc-b092-48e0-9766-4e8e51458589'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:12.351650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] The token cache is being invalidate because project e01114ffee3f4b56a38d8dba6e771b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:02:12.351938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:12.352664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b0c9badc-b092-48e0-9766-4e8e51458589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:02:12.354223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1122/2250] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:02:12 2022] DELETE /identity/v3/projects/e01114ffee3f4b56a38d8dba6e771b0e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:02:12.359376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.359662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.359942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.380917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:12.380917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:12.470188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1129/2251] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:02:12.472408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.472878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.473314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.497088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:12.498526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:12.507375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1123/2252] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:12.511408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.526095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3ba61-5837-42bf-bd21-1f8209a1fbc7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.532864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.533809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.534220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.534961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.536132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:02:12.536806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.539674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.567371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1130/2253] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:02:12.574840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.586485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadb036-b35e-43d7-91cd-98d9a36df936 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.593644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.594453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.594994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.595347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.596302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.600928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.629667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1124/2254] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:02:12 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:02:12.634010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.644534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff07b6-b55d-420b-beff-426923403c34 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.703904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.704708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.704972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.705158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.705854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.707755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.748018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1131/2255] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:02:12 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:02:12.748350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.759898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0c7e-1c29-4f33-ac7f-8abe9f1e1ff4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.765680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.766555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.767427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.767803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.768679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.770423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.788243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1125/2256] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:02:12.789494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.800245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee224cbb-9c2b-4ba1-ab25-833a80fa8f3c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.805153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9fa1-e45e-497e-b1d2-765c9a675c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.805834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9fa1-e45e-497e-b1d2-765c9a675c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.806120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9fa1-e45e-497e-b1d2-765c9a675c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.806427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9fa1-e45e-497e-b1d2-765c9a675c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.807176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9fa1-e45e-497e-b1d2-765c9a675c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.808900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9fa1-e45e-497e-b1d2-765c9a675c07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.815412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:12.821743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1132/2257] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:02:12.825873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:12.836445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49857997-56d4-46c0-bad5-791af6cf269b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:12.841068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:12.841952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.842228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.842499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] PATH_INFO: `/v3/projects/95b4310d4b154732b31c773044f56154/users/b51e11f068d948a889871ce53ce29ceb/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.857749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b4310d4b154732b31c773044f56154, user_id=b51e11f068d948a889871ce53ce29ceb, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:12.860703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:12.887117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1126/2258] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:02:12 2022] PUT /identity/v3/projects/95b4310d4b154732b31c773044f56154/users/b51e11f068d948a889871ce53ce29ceb/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:02:12.892971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f17c-6270-4e7f-8a6a-9b65feaa79e5 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:12.893266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f17c-6270-4e7f-8a6a-9b65feaa79e5 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:12.893550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01f17c-6270-4e7f-8a6a-9b65feaa79e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:12.912462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ac01f17c-6270-4e7f-8a6a-9b65feaa79e5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:12.913736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ac01f17c-6270-4e7f-8a6a-9b65feaa79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:12.992315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1133/2259] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:13.002632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:13.004424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:13.084031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f183-b27f-468d-bbd1-09debb0e454c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:13.092106 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a04ce-7d55-45c3-b108-9953c9af2c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:13.092779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a04ce-7d55-45c3-b108-9953c9af2c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:13.093115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a04ce-7d55-45c3-b108-9953c9af2c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:13.093393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a04ce-7d55-45c3-b108-9953c9af2c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:13.113226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a04ce-7d55-45c3-b108-9953c9af2c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:13.115288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a04ce-7d55-45c3-b108-9953c9af2c93 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:13.126773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1127/2260] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:02:16.772170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:16.773070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:16.773359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:16.791892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] MFA Rules not processed for user `dc1444d1ccf94601a11be7ed6f643798`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:16.793315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:16.856403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1134/2261] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:17.997994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:17.998841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:17.999125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.007527 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:18.035108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] MFA Rules not processed for user `b51e11f068d948a889871ce53ce29ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:18.036612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:18.125364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1128/2262] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:18.129769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:18.141427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db235c77-304b-4927-9109-ca8627d6cd78 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:18.146343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:18.147137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:18.147396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:18.147773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.148667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:18.150659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:18.183425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1135/2263] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:02:18 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:02:18.187448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:18.198592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717d23c-741d-4908-b8c5-dfbfee4998eb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:18.259020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:18.259661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:18.260003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:18.260350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.261068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:18.262971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:18.313434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1129/2264] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:02:18 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:02:18.318072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:18.330098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc705f-67af-413f-ac40-7d67081c419b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:18.335047 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:18.335780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:18.336173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:18.336620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.337425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:18.339625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:18.358377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:18.360222 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1136/2265] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:02:18.376045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4293-cd50-4ce7-80e1-873e4fd2daf7 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:18.391550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:18.392511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:18.392795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:18.393222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] PATH_INFO: `/v3/projects/94f946129dfc456583a41cac64b43373/users/7296e902ec604e3bbd5b6026f6cec6f9/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.410874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f946129dfc456583a41cac64b43373, user_id=7296e902ec604e3bbd5b6026f6cec6f9, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:18.413715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:18.429311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1130/2266] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:02:18 2022] PUT /identity/v3/projects/94f946129dfc456583a41cac64b43373/users/7296e902ec604e3bbd5b6026f6cec6f9/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:02:18.435438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:18.449272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99193b-94b2-4956-9575-ebf335df8c57 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:18.522940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ed52c-a4a2-4f3c-acac-b7871206dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:18.523437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed52c-a4a2-4f3c-acac-b7871206dcbc admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:18.523724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed52c-a4a2-4f3c-acac-b7871206dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:18.524031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ed52c-a4a2-4f3c-acac-b7871206dcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.524803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ed52c-a4a2-4f3c-acac-b7871206dcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:18.526436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ed52c-a4a2-4f3c-acac-b7871206dcbc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:18.538584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1137/2267] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:02:18.542647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:18.557550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a50dc-8e95-4927-8efc-d96f4f285e3c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:18.562988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:18.563967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:18.564379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:18.564668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] PATH_INFO: `/v3/projects/94f946129dfc456583a41cac64b43373/users/7296e902ec604e3bbd5b6026f6cec6f9/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:18.566685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f946129dfc456583a41cac64b43373, user_id=7296e902ec604e3bbd5b6026f6cec6f9, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:18.569388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:18.581394 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1131/2268] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:02:18 2022] PUT /identity/v3/projects/94f946129dfc456583a41cac64b43373/users/7296e902ec604e3bbd5b6026f6cec6f9/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:02:24.582232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90f74-d24c-4322-8751-f35f981fd4e9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:24.582783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90f74-d24c-4322-8751-f35f981fd4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:24.582783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d90f74-d24c-4322-8751-f35f981fd4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:24.603370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:24.615902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-18d90f74-d24c-4322-8751-f35f981fd4e9 None None] MFA Rules not processed for user `7296e902ec604e3bbd5b6026f6cec6f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:24.617186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-18d90f74-d24c-4322-8751-f35f981fd4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:24.714540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1138/2269] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:24.730222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:24.732242 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:24.851613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:24.923283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98110b99-deb8-4f03-882f-860514a3f24b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:24.944302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:24.945022 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:24.945307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:24.945584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:25.060101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:25.062290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:25.072756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1132/2270] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:02:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:02:33.702535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3de53-2c98-4e6e-a4c4-fc4fbab995b1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:33.702994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3de53-2c98-4e6e-a4c4-fc4fbab995b1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:33.703320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3de53-2c98-4e6e-a4c4-fc4fbab995b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:33.722982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-75a3de53-2c98-4e6e-a4c4-fc4fbab995b1 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:33.724239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-75a3de53-2c98-4e6e-a4c4-fc4fbab995b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:33.778134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1139/2271] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 10:02:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:02:33.790838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:02:33.792346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:33.866269 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8427d-5820-46a9-b0bf-3f65d7821d8d service nova] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:02:33.871230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228d8ed-2d5e-4925-bdd5-63bce2de1404 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:02:33.871774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228d8ed-2d5e-4925-bdd5-63bce2de1404 service swift] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:33.872092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228d8ed-2d5e-4925-bdd5-63bce2de1404 service swift] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:33.872375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228d8ed-2d5e-4925-bdd5-63bce2de1404 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:33.880970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228d8ed-2d5e-4925-bdd5-63bce2de1404 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:02:33.882564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228d8ed-2d5e-4925-bdd5-63bce2de1404 service swift] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:02:33.891840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1133/2272] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:02:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:02:43.771542 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=55 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:43.891557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=68 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:02:51.984814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a67673-b013-43b7-86ef-62e56e02d682 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:51.985358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a67673-b013-43b7-86ef-62e56e02d682 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:51.985358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a67673-b013-43b7-86ef-62e56e02d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:52.003817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a8a67673-b013-43b7-86ef-62e56e02d682 None None] MFA Rules not processed for user `b51e11f068d948a889871ce53ce29ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:52.005058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a8a67673-b013-43b7-86ef-62e56e02d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:52.011937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1140/2273] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:02:56.878740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:02:56.879300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:02:56.879300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:02:56.898841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] MFA Rules not processed for user `7e98533664dd4bf6b90e471fc42ba41f`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:02:56.900102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:02:56.964495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1134/2274] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:03:01.997979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:02.489328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:02.489619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:02.489891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:02.507989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] MFA Rules not processed for user `d3d76c556b5f41f19c1a2a466a031cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:03:02.510338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:02.565973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1141/2275] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:03:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:03:06.957461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=25 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:12.558647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=25 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:23.705372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:23.763551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75332456-4ddd-4c30-bc65-b9c0598f63d0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:23.768195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:23.768854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:23.769140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:23.769422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:23.779250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:23.780745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:23.791617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1135/2276] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:03:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:03:32.226811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:32.228409 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:32.298809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef6c63-d3d9-40f8-af64-0960a4a32b7d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:32.304800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:32.306179 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:32.306637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:32.307061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] PATH_INFO: `/v3/users/dc1444d1ccf94601a11be7ed6f643798` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:32.308302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1444d1ccf94601a11be7ed6f643798)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:32.310278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:32.357629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1444d1ccf94601a11be7ed6f643798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.370474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1444d1ccf94601a11be7ed6f643798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.378325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1444d1ccf94601a11be7ed6f643798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.385579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1444d1ccf94601a11be7ed6f643798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.386249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e49bf32b-ac38-4290-8955-efc339ccdd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1444d1ccf94601a11be7ed6f643798'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.392859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1142/2277] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:03:32 2022] DELETE /identity/v3/users/dc1444d1ccf94601a11be7ed6f643798 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:03:32.572234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:32.583030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349773cf-5f46-4246-b495-190beddbb0ed service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:32.641245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:32.642126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:32.642440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:32.642720 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] PATH_INFO: `/v3/projects/8918c8442bf64ad28ea153a36b194f8a` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:32.643910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8918c8442bf64ad28ea153a36b194f8a)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:32.645922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:32.691915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8918c8442bf64ad28ea153a36b194f8a', 'request_id': 'req-5f16e34e-506b-4858-80c6-525287fb6637'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.698044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8918c8442bf64ad28ea153a36b194f8a', 'request_id': 'req-5f16e34e-506b-4858-80c6-525287fb6637'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.705491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8918c8442bf64ad28ea153a36b194f8a', 'request_id': 'req-5f16e34e-506b-4858-80c6-525287fb6637'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.715850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] The token cache is being invalidate because project 8918c8442bf64ad28ea153a36b194f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:03:32.716163 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.716781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:03:32.718289 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1136/2278] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:03:32 2022] DELETE /identity/v3/projects/8918c8442bf64ad28ea153a36b194f8a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:03:42.389345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:42.712908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:43.418131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:43.418608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:43.418703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:43.436139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] MFA Rules not processed for user `bf85b80a4bb747da9bd07454536380c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:03:43.437783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:43.494459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1143/2279] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:03:48.418287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:48.419888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:48.476313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e34e-506b-4858-80c6-525287fb6637 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:48.479833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:48.480500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:48.480784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:48.481060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:48.482834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:48.555303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:48.556764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:48.567494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1137/2280] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:03:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:03:53.377092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:53.379548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:53.407178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21aa8-10c8-4ce6-abf7-336a93fbf5df None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:53.415897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:53.416606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:53.416898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:53.417177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:53.419071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:53.501596 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:53.503511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:53.524837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1144/2281] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:03:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:03:53.752651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:53.754145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:53.765617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835930b-f727-46a8-b7e4-163fd96877aa service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:53.770207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:53.770841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:53.771119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:53.771392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:53.773487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:53.792908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:53.794671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bea35-3423-44e9-8b8e-e0afdd1414b0 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:53.807125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1138/2282] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:03:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:03:55.252138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:55.253607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:55.315063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b380-0f4b-4d71-829f-886a0e96ad3a service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:55.319446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:55.320204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:55.320555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:55.320898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:55.322834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:55.395944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:55.398035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:55.402728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:03:55.418133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1145/2283] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:03:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:03:56.863055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b275c3-f089-40cb-8151-b7523318349c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:56.863939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b275c3-f089-40cb-8151-b7523318349c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:56.864499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b275c3-f089-40cb-8151-b7523318349c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:56.881912 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a1b275c3-f089-40cb-8151-b7523318349c None None] MFA Rules not processed for user `1fde108762d645bc9c5c5791dfe646a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:03:56.883120 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a1b275c3-f089-40cb-8151-b7523318349c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:56.891162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1139/2284] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:03:57.575420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:03:57.576862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:57.657927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145fc2e-5d21-4275-825e-0c7c9016b6bf service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:03:57.663524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:03:57.664200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:03:57.664487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:03:57.664767 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:03:57.666558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:03:57.678148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:03:57.679775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:03:57.690144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1146/2285] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:03:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:01.754428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:01.754873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:01.754985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:01.772978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:01.774197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:01.829464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1140/2286] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 10:04:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:01.875619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:01.877012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:01.943231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f42eb1-78a2-4825-804a-7c4a4a5cdf26 service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:01.948204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:01.948835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:01.949114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:01.949389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:01.957309 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:01.958879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:01.966732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1147/2287] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:04:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:04:04.918130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:04.928529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d67a5-5d5a-48ae-9a10-5abd4251b566 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:04.932144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:04.932786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:04.933069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:04.933347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:04.935158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:04.945981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:04.947429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:04.956147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1141/2288] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:05.344139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:05.345588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:05.362272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d472db-69e2-4283-892b-a8c6dd02f495 service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:05.374715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:05.375471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:05.375846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:05.376242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:05.382838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:05.464518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:05.466120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:05.477939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1148/2289] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:06.078118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:06.079620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:06.112381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da3723-1205-4ee8-b875-6b19f420bdd6 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:06.119283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:06.120192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:06.120751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:06.121136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:06.124223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:06.147805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:06.149447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:06.156258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:06.163754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1142/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:10.626484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:10.632037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:10.651456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:10.716402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426c202-e59d-42b5-8502-e2544f8fe66e service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:10.723387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:10.727571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:10.727927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:10.730239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] PATH_INFO: `/v3/users/cd37e2b041ae441fb1c1ae1d77570820` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:10.731833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd37e2b041ae441fb1c1ae1d77570820)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:10.734095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:10.789270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd37e2b041ae441fb1c1ae1d77570820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:10.804644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd37e2b041ae441fb1c1ae1d77570820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:10.813986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd37e2b041ae441fb1c1ae1d77570820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:10.826272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd37e2b041ae441fb1c1ae1d77570820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:10.827010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd37e2b041ae441fb1c1ae1d77570820'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:10.834125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1149/2291] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:10 2022] DELETE /identity/v3/users/cd37e2b041ae441fb1c1ae1d77570820 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:11.040262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:11.051470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a1a8-91d6-4c5a-9d4b-0c040092d3d2 service placement] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:11.111405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:11.112673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:11.113494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:11.113942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] PATH_INFO: `/v3/projects/705097e0a13f400d820a4e6c6720c101` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:11.115466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=705097e0a13f400d820a4e6c6720c101)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:11.117442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:11.168463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705097e0a13f400d820a4e6c6720c101', 'request_id': 'req-b69892ac-e2de-432c-a826-fb9cc4614261'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.174943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705097e0a13f400d820a4e6c6720c101', 'request_id': 'req-b69892ac-e2de-432c-a826-fb9cc4614261'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.185711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705097e0a13f400d820a4e6c6720c101', 'request_id': 'req-b69892ac-e2de-432c-a826-fb9cc4614261'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.197505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] The token cache is being invalidate because project 705097e0a13f400d820a4e6c6720c101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:11.197794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.198448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.200230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1143/2292] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:11 2022] DELETE /identity/v3/projects/705097e0a13f400d820a4e6c6720c101 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:04:11.204052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:11.205460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:11.219024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f29347-3d81-40a7-b1f1-7db3e6602175 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:11.279003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:11.279871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:11.280187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:11.280464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] PATH_INFO: `/v3/users/568f5a3bc85845c5b3423a93dc9676c4` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:11.281634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568f5a3bc85845c5b3423a93dc9676c4)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:11.283550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:11.326454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:11.337147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568f5a3bc85845c5b3423a93dc9676c4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.352829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568f5a3bc85845c5b3423a93dc9676c4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.360493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568f5a3bc85845c5b3423a93dc9676c4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.368722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568f5a3bc85845c5b3423a93dc9676c4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.369519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568f5a3bc85845c5b3423a93dc9676c4'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.375487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1150/2293] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:11 2022] DELETE /identity/v3/users/568f5a3bc85845c5b3423a93dc9676c4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:04:11.548139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:11.549640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:11.563460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69892ac-e2de-432c-a826-fb9cc4614261 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:11.620603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:11.621464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:11.621742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:11.622017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] PATH_INFO: `/v3/projects/80c7f6a2b4a546de8dd1d9c5457d81e7` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:11.623190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c7f6a2b4a546de8dd1d9c5457d81e7)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:11.625130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:11.657580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:11.671448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c7f6a2b4a546de8dd1d9c5457d81e7', 'request_id': 'req-6e4ecb8f-71ea-4aab-864f-6238709ec14e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.678115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c7f6a2b4a546de8dd1d9c5457d81e7', 'request_id': 'req-6e4ecb8f-71ea-4aab-864f-6238709ec14e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.685200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c7f6a2b4a546de8dd1d9c5457d81e7', 'request_id': 'req-6e4ecb8f-71ea-4aab-864f-6238709ec14e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.695202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] The token cache is being invalidate because project 80c7f6a2b4a546de8dd1d9c5457d81e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:11.695484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.696132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:11.697647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1144/2294] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:11 2022] DELETE /identity/v3/projects/80c7f6a2b4a546de8dd1d9c5457d81e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:13.892754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:13.895917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:13.986898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba5308-096f-41f2-b31b-8ed3f5f70ef7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:14.050036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:14.051145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:14.051427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:14.051706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:14.053509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:14.065282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:14.067513 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:14.077869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1151/2295] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:21.692333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:22.439319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:22.440790 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:22.496536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ecb8f-71ea-4aab-864f-6238709ec14e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:22.500079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:22.500709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:22.501015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:22.501294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:22.503010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:22.563587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:22.565057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:22.575448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1145/2296] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:24.073525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=77,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:26.805584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:26.807471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:26.870955 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:26.872568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:26.891698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965177b9-ef1d-46a6-a0fc-c44a99136aad service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:26.897410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:26.898975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:26.899424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:26.899602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491301-1b3e-4532-8656-e05ee15ca106 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:26.899861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] PATH_INFO: `/v3/users/7e98533664dd4bf6b90e471fc42ba41f` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:26.901113 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e98533664dd4bf6b90e471fc42ba41f)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:26.903048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:26.905272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:26.905962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:26.906499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:26.906499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:26.909400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:26.921969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:26.923583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:26.934880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1152/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:26.972939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e98533664dd4bf6b90e471fc42ba41f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:26.990035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e98533664dd4bf6b90e471fc42ba41f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:26.990894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e98533664dd4bf6b90e471fc42ba41f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:26.999308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e98533664dd4bf6b90e471fc42ba41f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.011474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-53402c73-2453-4430-a645-921d978b0cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e98533664dd4bf6b90e471fc42ba41f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.023805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1146/2298] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:26 2022] DELETE /identity/v3/users/7e98533664dd4bf6b90e471fc42ba41f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:27.217469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.233982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de0ae3-98b7-401f-b504-4a053eab0a47 service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.294680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.295889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.296202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.296482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] PATH_INFO: `/v3/projects/7a80df511c544924a5708de2513bbc42` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.297668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a80df511c544924a5708de2513bbc42)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.299602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.348411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a80df511c544924a5708de2513bbc42', 'request_id': 'req-bf910782-2c94-4e89-a320-6b5315ef04e1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.354528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a80df511c544924a5708de2513bbc42', 'request_id': 'req-bf910782-2c94-4e89-a320-6b5315ef04e1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.361503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a80df511c544924a5708de2513bbc42', 'request_id': 'req-bf910782-2c94-4e89-a320-6b5315ef04e1'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.373308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] The token cache is being invalidate because project 7a80df511c544924a5708de2513bbc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:27.373598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.374248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bf910782-2c94-4e89-a320-6b5315ef04e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:27.376028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1153/2299] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:27 2022] DELETE /identity/v3/projects/7a80df511c544924a5708de2513bbc42 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:27.381759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.381759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.381759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.401026 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:27.402240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:27.419466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:27.469946 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1147/2300] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:27.478154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.478441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.478718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.498881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:27.499274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:27.508997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1154/2301] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:27.513174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.523589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ce6ce-c919-4f11-88b7-ca0fc7c9f78a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.528228 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.528905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.529218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.529493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.530241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:04:27.530624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.532177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.547713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1148/2302] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:04:27.552102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.561830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ba1e7-89ab-4dac-8982-ba9ad225b06b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.566731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.567455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.567810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.568185 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.568988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.570990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.582773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:27.606327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1155/2303] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:27.607544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.618882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a45e1a-0941-4820-9b63-613a4272dcce admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.680416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.681086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.681372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.681649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.682351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.684364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.709126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1149/2304] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:27 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:27.710537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.720780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422c81-7c4b-41ab-9605-5bc95755e2dc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.725721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.726414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.726696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.726971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.727751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.729549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.741033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1156/2305] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:27.744990 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.756277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2974791-7d8b-4648-9759-84c4f86fbda5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.762628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c857bc8-df36-4be6-8e12-d5acb3c0e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.763263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c857bc8-df36-4be6-8e12-d5acb3c0e304 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.764080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c857bc8-df36-4be6-8e12-d5acb3c0e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.764080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c857bc8-df36-4be6-8e12-d5acb3c0e304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.764578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c857bc8-df36-4be6-8e12-d5acb3c0e304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.766174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c857bc8-df36-4be6-8e12-d5acb3c0e304 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.777659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1150/2306] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:04:27.786958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.797938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d187b-0fb2-49ee-9af0-ba081a092199 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:27.803210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:27.804131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.804439 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.804713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] PATH_INFO: `/v3/projects/93f361e33f094371b177c5872b9506b5/users/7071b67884f6466b9378ea25407f9d72/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.821469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f361e33f094371b177c5872b9506b5, user_id=7071b67884f6466b9378ea25407f9d72, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:27.824153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:27.837795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1157/2307] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:27 2022] PUT /identity/v3/projects/93f361e33f094371b177c5872b9506b5/users/7071b67884f6466b9378ea25407f9d72/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:04:27.848540 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a9b8-ac27-47ad-9460-5172bb38ef21 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:27.848837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a9b8-ac27-47ad-9460-5172bb38ef21 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:27.849116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a9b8-ac27-47ad-9460-5172bb38ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:27.877089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-cea8a9b8-ac27-47ad-9460-5172bb38ef21 None None] MFA Rules not processed for user `7071b67884f6466b9378ea25407f9d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:27.878207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-cea8a9b8-ac27-47ad-9460-5172bb38ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:27.948451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1151/2308] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:27.959751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:27.961811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:28.041723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21422b5-c29a-4c97-9b9c-376710e8df07 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:28.052590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:28.054074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:28.054363 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:28.054641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:28.063084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:28.064747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:28.073843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1158/2309] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:28.752373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:28.752666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:28.752954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:28.771548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] MFA Rules not processed for user `d3d76c556b5f41f19c1a2a466a031cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:28.772769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:28.784516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:28.827307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1152/2310] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:29.125990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:29.127398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:29.183504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3596-0163-4ff0-b114-3d87ffea1bb5 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:29.187033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:29.187669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:29.187956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:29.188265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:29.190039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:29.199946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:29.201399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:29.209293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1159/2311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:34.408027 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:34.411387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:34.459086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c6ef4-8cc8-4c2c-a694-23e6798e3561 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:34.471489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:34.472558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:34.473887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:34.474475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:34.477184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:34.491554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:34.493313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22d58a-407c-4874-b06e-3cda947330f3 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:34.505624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1153/2312] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:35.603806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:35.646417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:35.665261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76887ae3-0440-4b6e-914c-f18731a3eaa2 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:35.669875 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:35.670736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:35.671016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:35.671289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] PATH_INFO: `/v3/users/7071b67884f6466b9378ea25407f9d72` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:35.672510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7071b67884f6466b9378ea25407f9d72)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:35.674414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:35.719288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7071b67884f6466b9378ea25407f9d72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:35.731848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7071b67884f6466b9378ea25407f9d72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:35.739802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7071b67884f6466b9378ea25407f9d72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:35.746769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7071b67884f6466b9378ea25407f9d72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:35.747447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7071b67884f6466b9378ea25407f9d72'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:35.753273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1160/2313] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:35 2022] DELETE /identity/v3/users/7071b67884f6466b9378ea25407f9d72 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:35.757862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:35.758355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:35.758451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:35.776839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:35.778088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:35.840911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1154/2314] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:35.851143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:35.852570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:35.913674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24947dbc-eec8-4e17-afae-48057639ef7a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:35.917304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfd49f-f923-49c0-a7c9-3b728964bb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:35.917951 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd49f-f923-49c0-a7c9-3b728964bb91 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:35.918235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd49f-f923-49c0-a7c9-3b728964bb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:35.918520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfd49f-f923-49c0-a7c9-3b728964bb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:35.928518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfd49f-f923-49c0-a7c9-3b728964bb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:35.929953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfd49f-f923-49c0-a7c9-3b728964bb91 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:35.939537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1161/2315] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:36.215021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.216980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:36.239187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0aa5-80e6-4e46-a05d-4dfdae4b43ed None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.246082 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.246943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.247220 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.247492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] PATH_INFO: `/v3/projects/93f361e33f094371b177c5872b9506b5` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.248703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f361e33f094371b177c5872b9506b5)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.250624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.298224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f361e33f094371b177c5872b9506b5', 'request_id': 'req-73ac2c8a-2170-4779-9131-c4870d75c3b4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:36.304846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f361e33f094371b177c5872b9506b5', 'request_id': 'req-73ac2c8a-2170-4779-9131-c4870d75c3b4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:36.312007 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f361e33f094371b177c5872b9506b5', 'request_id': 'req-73ac2c8a-2170-4779-9131-c4870d75c3b4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:36.322784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] The token cache is being invalidate because project 93f361e33f094371b177c5872b9506b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:36.323072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:36.323696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-73ac2c8a-2170-4779-9131-c4870d75c3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:36.325270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1155/2316] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:36 2022] DELETE /identity/v3/projects/93f361e33f094371b177c5872b9506b5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:36.330171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.330457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.330740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.349037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:36.350254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:36.410680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1162/2317] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:36.419591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.419887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.420203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.438067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:36.439270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:36.448020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1156/2318] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:36.452146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.462483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5897f-6634-4731-8fc4-7d8122258b82 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.467049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.467701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.468009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.468291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.469017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:04:36.469358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.470946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.472507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:36.484916 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1163/2319] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:04:36.489700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.499631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8bf6b-cfc8-489a-891a-8d951ea6567a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.505078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.505737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.506021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.506299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.507001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.508937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.537968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1157/2320] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:36.539431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.550290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b0f5-bf5d-4723-8013-f29a68e2b428 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.611856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.612550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.612834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.613107 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.614295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.616598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.636797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1164/2321] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:36.640842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.647426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:36.652081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cf088-ba47-415d-b7a2-0cced1bf5efd admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.658018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.658837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.659325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.659667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.660740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.662397 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.672944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1158/2322] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:36.677367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.687402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145f30-fbfa-4c9e-8959-aa897579d662 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.692617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a615879-e2cf-4175-be3c-6c397507996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.693268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615879-e2cf-4175-be3c-6c397507996c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.693551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615879-e2cf-4175-be3c-6c397507996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.693826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615879-e2cf-4175-be3c-6c397507996c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.694553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a615879-e2cf-4175-be3c-6c397507996c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.696156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a615879-e2cf-4175-be3c-6c397507996c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.705877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1165/2323] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:36.709755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.719390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0c8a3-3a80-452a-9d39-47bcfe33bf50 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.723933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.724828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.725108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.725381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] PATH_INFO: `/v3/projects/f09f8a4a4d4045a59217f7952b8274a3/users/728d3bb8890c41a48a31ee8ac700226c/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.740417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09f8a4a4d4045a59217f7952b8274a3, user_id=728d3bb8890c41a48a31ee8ac700226c, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.743116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.756561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1159/2324] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:36 2022] PUT /identity/v3/projects/f09f8a4a4d4045a59217f7952b8274a3/users/728d3bb8890c41a48a31ee8ac700226c/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:36.766528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.766822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.767128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.793407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] MFA Rules not processed for user `728d3bb8890c41a48a31ee8ac700226c`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:36.794637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:36.857303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1166/2325] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:36.861923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.923118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1f20d-c5d2-4cf0-93e7-27c6f4f0857e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:36.928549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:36.929192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:36.929475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:36.929750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:36.930434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:36.932355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:36.958358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1160/2326] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:36.962538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:36.974104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5599edb-712a-48a4-9fec-82f7f5d9cf10 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.030299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.030967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.031250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.031524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.032258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.034165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.042635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:37.057638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1167/2327] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:36 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:37.061616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:37.072123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfb934-dbea-41e9-bfed-ddc28708707a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.076811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.077668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.077793 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.077991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.078708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.080352 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.091833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1161/2328] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:37.100358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:37.110302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b9df-48c7-4a29-a282-3ee73183364b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.116621 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.117515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.117796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.118067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] PATH_INFO: `/v3/projects/9b81679c6bee4af6be8ffaf22423c70b/users/6b547f1d31f644da9eb644fbcf3dc224/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.134946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b81679c6bee4af6be8ffaf22423c70b, user_id=6b547f1d31f644da9eb644fbcf3dc224, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.137636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.151935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1168/2329] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:37 2022] PUT /identity/v3/projects/9b81679c6bee4af6be8ffaf22423c70b/users/6b547f1d31f644da9eb644fbcf3dc224/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:37.155928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:37.166647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531acce1-6148-4452-825b-65e4799260a1 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.223762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bfef4-3395-4bc4-989f-0a80a6a831af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.224459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bfef4-3395-4bc4-989f-0a80a6a831af admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.224737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bfef4-3395-4bc4-989f-0a80a6a831af admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.225008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bfef4-3395-4bc4-989f-0a80a6a831af admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.225761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bfef4-3395-4bc4-989f-0a80a6a831af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.227362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bfef4-3395-4bc4-989f-0a80a6a831af admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.237104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1162/2330] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:04:37.241346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:37.251530 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b251c-cc2e-4c5f-9433-b9fbac978a51 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.256509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.257395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.257677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.257948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] PATH_INFO: `/v3/projects/9b81679c6bee4af6be8ffaf22423c70b/users/6b547f1d31f644da9eb644fbcf3dc224/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.259911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b81679c6bee4af6be8ffaf22423c70b, user_id=6b547f1d31f644da9eb644fbcf3dc224, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.263555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.274819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1169/2331] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:37 2022] PUT /identity/v3/projects/9b81679c6bee4af6be8ffaf22423c70b/users/6b547f1d31f644da9eb644fbcf3dc224/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:37.284798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.285085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.285994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.312083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] MFA Rules not processed for user `6b547f1d31f644da9eb644fbcf3dc224`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:37.313310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:37.341511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:37.381440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1163/2332] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:37.392523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:37.394193 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:37.450847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30004a-1dbf-4b52-a854-5101057f1409 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.454507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.455159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.455426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.455703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.465221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.466580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.476462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1170/2333] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:37.517116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:37.518529 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:37.530798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1523b-86c5-4cc0-a7c3-5ea6100c1e08 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:37.534459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:37.535092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:37.536069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:37.536350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:37.593085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:37.594544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:37.603931 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1164/2334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:04:39.190763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:39.194268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:39.274793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082f94f-14a1-42e3-9070-207e100ac1bb service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:39.282131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:39.282774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:39.283061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:39.283357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:39.285203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:39.297861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:39.299535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de20355-0b48-4ab5-8e2d-fdbef91620bd service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:39.310260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1171/2335] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:41.040035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:41.101609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540306f6-b038-4ca6-9fca-f17cb1301835 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:41.106623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:41.107492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:41.107771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:41.108081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] PATH_INFO: `/v3/users/728d3bb8890c41a48a31ee8ac700226c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:41.109266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] RBAC: Authorizing `identity:delete_user(user_id=728d3bb8890c41a48a31ee8ac700226c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:41.113859 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:41.161544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728d3bb8890c41a48a31ee8ac700226c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:41.173457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728d3bb8890c41a48a31ee8ac700226c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:41.174252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728d3bb8890c41a48a31ee8ac700226c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:41.175585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:41.183151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728d3bb8890c41a48a31ee8ac700226c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:41.191240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728d3bb8890c41a48a31ee8ac700226c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:41.198710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1165/2336] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:41 2022] DELETE /identity/v3/users/728d3bb8890c41a48a31ee8ac700226c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:41.203232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:41.203682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:41.203867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:41.221403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:41.222757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:41.262692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:41.289849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1172/2337] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:41.299753 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:41.301737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:41.369928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115246-fcc6-4565-b7a8-c7860036240f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:41.373583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:41.374224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:41.374575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:41.374850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:41.384643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:41.386072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:41.395725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1166/2338] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:42.109220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:42.110896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:42.123946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52443487-8828-4f99-8731-48ffa32a5319 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:42.128784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:42.130211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:42.130898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:42.130898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] PATH_INFO: `/v3/projects/f09f8a4a4d4045a59217f7952b8274a3` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:42.131967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09f8a4a4d4045a59217f7952b8274a3)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:42.133922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:42.183350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09f8a4a4d4045a59217f7952b8274a3', 'request_id': 'req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.189751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09f8a4a4d4045a59217f7952b8274a3', 'request_id': 'req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.199760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09f8a4a4d4045a59217f7952b8274a3', 'request_id': 'req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.211668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] The token cache is being invalidate because project f09f8a4a4d4045a59217f7952b8274a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:42.212316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.212792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.214450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1173/2339] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:42 2022] DELETE /identity/v3/projects/f09f8a4a4d4045a59217f7952b8274a3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:42.218393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:42.228068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5987c4-7014-4477-b773-ad8d54b8253f service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:42.284459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:42.285366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:42.285652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:42.285930 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] PATH_INFO: `/v3/users/6b547f1d31f644da9eb644fbcf3dc224` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:42.287116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b547f1d31f644da9eb644fbcf3dc224)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:42.289086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:42.336056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b547f1d31f644da9eb644fbcf3dc224'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.349606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b547f1d31f644da9eb644fbcf3dc224'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.350411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b547f1d31f644da9eb644fbcf3dc224'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.358526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b547f1d31f644da9eb644fbcf3dc224'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.366410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d416f57-b2a6-45bb-95f7-0e8a05660080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b547f1d31f644da9eb644fbcf3dc224'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.372588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1167/2340] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:42 2022] DELETE /identity/v3/users/6b547f1d31f644da9eb644fbcf3dc224 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:42.785856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:42.787342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:42.807670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb4e8c-8512-4b72-9a7c-f6d7e1cb1dce admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:42.891997 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:42.893418 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:42.893775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:42.894063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] PATH_INFO: `/v3/projects/9b81679c6bee4af6be8ffaf22423c70b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:42.895425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b81679c6bee4af6be8ffaf22423c70b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:42.898388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:42.956612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b81679c6bee4af6be8ffaf22423c70b', 'request_id': 'req-238889ec-14f2-48d9-a326-b9c3ec3f1e43'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.971294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b81679c6bee4af6be8ffaf22423c70b', 'request_id': 'req-238889ec-14f2-48d9-a326-b9c3ec3f1e43'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.980925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b81679c6bee4af6be8ffaf22423c70b', 'request_id': 'req-238889ec-14f2-48d9-a326-b9c3ec3f1e43'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:42.996379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:43.008437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] The token cache is being invalidate because project 9b81679c6bee4af6be8ffaf22423c70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:43.008991 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:43.009952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-238889ec-14f2-48d9-a326-b9c3ec3f1e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:43.012029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1174/2341] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:42 2022] DELETE /identity/v3/projects/9b81679c6bee4af6be8ffaf22423c70b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:43.016760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e92075-2ba6-41de-800a-509914695536 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.017055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e92075-2ba6-41de-800a-509914695536 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.017338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e92075-2ba6-41de-800a-509914695536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.025067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:43.038588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-29e92075-2ba6-41de-800a-509914695536 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:43.040538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-29e92075-2ba6-41de-800a-509914695536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:43.136974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1168/2342] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:43.139835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.140302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.140668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.161011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:43.162583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:43.177296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1175/2343] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:43.178629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e92075-2ba6-41de-800a-509914695536 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.189584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e92075-2ba6-41de-800a-509914695536 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.201508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.202190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.202469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.202739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.203470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:04:43.203776 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.205412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.222784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1169/2344] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:04:43.225108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.231900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.233757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:43.235059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8775-ad3b-4123-a932-2bcc5d593f70 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.239823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.240790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.241074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.241351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.242051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.243958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.276650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1176/2345] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:43.280664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.333078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588b55-8d7e-468a-abf4-2caffa57e40d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.365655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d205911-f626-4926-9cd9-77d46229a006 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.373868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.374912 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.375399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.375894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.376839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.380463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.410162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.412590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.412898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.413195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.417446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:43.421862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1177/2346] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:43.423449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.442430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ac148-799b-4854-a318-2301a423a4e9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.449498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.450341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.450630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.450915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.451681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.453376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.463803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=100 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:43.484134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1178/2347] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:43.487995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.499665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930713a3-9d7c-4f4f-8f56-5c4f6e8f43d0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.506567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.508233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.509108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b829b-f0ce-46e9-9994-e7db48944caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.509861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b829b-f0ce-46e9-9994-e7db48944caf admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.510095 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b829b-f0ce-46e9-9994-e7db48944caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.510375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b829b-f0ce-46e9-9994-e7db48944caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.511105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b829b-f0ce-46e9-9994-e7db48944caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.512807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b829b-f0ce-46e9-9994-e7db48944caf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.518339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1170/2348] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:04:43.525749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1179/2349] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:04:43.529742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.541310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc145d66-d87d-46a7-a94a-1cf0f3c22d4e service nova] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.546050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.546945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.547233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.547513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] PATH_INFO: `/v3/projects/767429e5b52c4abb99709d1c818e2728/users/9cea0d6d69584764a5cc7f492838057e/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.565350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767429e5b52c4abb99709d1c818e2728, user_id=9cea0d6d69584764a5cc7f492838057e, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.568662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.583486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1171/2350] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:43 2022] PUT /identity/v3/projects/767429e5b52c4abb99709d1c818e2728/users/9cea0d6d69584764a5cc7f492838057e/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:04:43.593524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.593802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.594081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.622359 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] MFA Rules not processed for user `9cea0d6d69584764a5cc7f492838057e`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:43.623587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:43.693716 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1180/2351] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:43.697971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.767079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3c974-791c-4fc2-9363-69135631c302 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.774524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.775642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.776058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.776418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.777297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.779192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.813664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1172/2352] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:43.826020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.838792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341b94-e8b3-451a-9de0-7b818e74cb8d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.864615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:43.914426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.915215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.915515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.915861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.916675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.919667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.946186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1181/2353] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:43 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:43.950232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.961964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88bc4c-5bb6-4c51-bc51-c8b79fd526e8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:43.966777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:43.967544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:43.967828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:43.968331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:43.969073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:43.970749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:43.981810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1173/2354] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:43.985994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:43.997257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28be10-4328-445e-8be7-9b7cf0710a3b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:44.002588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:44.003555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.003954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.004880 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] PATH_INFO: `/v3/projects/5a79db86a0cd4054808dc51f6119135d/users/d78bcab05492474086a2a828a0d802fb/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.020118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a79db86a0cd4054808dc51f6119135d, user_id=d78bcab05492474086a2a828a0d802fb, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:44.023149 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:44.036150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1182/2355] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:43 2022] PUT /identity/v3/projects/5a79db86a0cd4054808dc51f6119135d/users/d78bcab05492474086a2a828a0d802fb/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:44.040062 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:44.049894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fb748-78eb-4cc8-8958-c1313a431f53 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:44.113995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fef4f-3018-4d9d-bb24-be9963bf47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:44.114812 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fef4f-3018-4d9d-bb24-be9963bf47c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.115460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fef4f-3018-4d9d-bb24-be9963bf47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.115796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fef4f-3018-4d9d-bb24-be9963bf47c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.116636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fef4f-3018-4d9d-bb24-be9963bf47c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:44.118292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fef4f-3018-4d9d-bb24-be9963bf47c7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:44.129817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1174/2356] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:04:44.134012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:44.144950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe2604-66e4-4608-a682-b6163616921c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:44.149804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:44.151673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.151960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.153085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] PATH_INFO: `/v3/projects/5a79db86a0cd4054808dc51f6119135d/users/d78bcab05492474086a2a828a0d802fb/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.156063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a79db86a0cd4054808dc51f6119135d, user_id=d78bcab05492474086a2a828a0d802fb, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:44.159093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:44.169771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1183/2357] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:44 2022] PUT /identity/v3/projects/5a79db86a0cd4054808dc51f6119135d/users/d78bcab05492474086a2a828a0d802fb/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:44.180334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.180630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.180913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.204547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:44.207590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] MFA Rules not processed for user `d78bcab05492474086a2a828a0d802fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:44.209400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:44.276433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1175/2358] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:44.287278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:44.289063 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:44.347516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552cd03-a4e4-4e89-ac98-3dfdbd77c83f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:44.351646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809f63a-fbb1-4a45-8e0c-0ffadbb12b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:44.352319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809f63a-fbb1-4a45-8e0c-0ffadbb12b5f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.352603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809f63a-fbb1-4a45-8e0c-0ffadbb12b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.352878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809f63a-fbb1-4a45-8e0c-0ffadbb12b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.362051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809f63a-fbb1-4a45-8e0c-0ffadbb12b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:44.364078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809f63a-fbb1-4a45-8e0c-0ffadbb12b5f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:44.373579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1184/2359] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:44.510407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:44.571286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814c965-6ccf-44fd-8bad-087a0f556a59 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:44.575914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:44.576815 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.577094 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.577366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] PATH_INFO: `/v3/users/9cea0d6d69584764a5cc7f492838057e` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.578535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cea0d6d69584764a5cc7f492838057e)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:44.580502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:44.624791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cea0d6d69584764a5cc7f492838057e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:44.636418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cea0d6d69584764a5cc7f492838057e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:44.637067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cea0d6d69584764a5cc7f492838057e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:44.643780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cea0d6d69584764a5cc7f492838057e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:44.650333 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cea0d6d69584764a5cc7f492838057e'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:44.656415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1176/2360] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:44 2022] DELETE /identity/v3/users/9cea0d6d69584764a5cc7f492838057e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:44.661540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.661830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.662106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.680046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:44.681176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:44.743191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1185/2361] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:44.753033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:44.754441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:44.775700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:44.815090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77441c-c40f-4e73-b2bf-7aa219bcfa85 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:44.818694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:44.819346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:44.819606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:44.819877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:44.828723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:44.830134 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:44.839861 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1177/2362] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:04:45.109313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:45.110769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:45.126089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613ffba-f25e-497b-84c7-b278562ca129 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:45.131315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:45.132241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.132522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.132798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] PATH_INFO: `/v3/projects/767429e5b52c4abb99709d1c818e2728` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.134572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767429e5b52c4abb99709d1c818e2728)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:45.136625 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:45.153785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:45.183675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767429e5b52c4abb99709d1c818e2728', 'request_id': 'req-d91c6696-955b-49c1-b02a-ad0f26918f55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.189619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767429e5b52c4abb99709d1c818e2728', 'request_id': 'req-d91c6696-955b-49c1-b02a-ad0f26918f55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.197539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767429e5b52c4abb99709d1c818e2728', 'request_id': 'req-d91c6696-955b-49c1-b02a-ad0f26918f55'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.208508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] The token cache is being invalidate because project 767429e5b52c4abb99709d1c818e2728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:45.208796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.209417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.210975 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1186/2363] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:45 2022] DELETE /identity/v3/projects/767429e5b52c4abb99709d1c818e2728 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:45.214907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:45.224495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d814e-a5fa-4f1e-aa80-58895ab60e9a service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:45.281434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:45.282291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.282576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.282856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] PATH_INFO: `/v3/users/d78bcab05492474086a2a828a0d802fb` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.284069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78bcab05492474086a2a828a0d802fb)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:45.286020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:45.330200 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78bcab05492474086a2a828a0d802fb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.342428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78bcab05492474086a2a828a0d802fb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.343095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78bcab05492474086a2a828a0d802fb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.350167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78bcab05492474086a2a828a0d802fb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.356849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-451b4dc2-cff5-44a4-a4a3-79fc0514644d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78bcab05492474086a2a828a0d802fb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.362886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1178/2364] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:45 2022] DELETE /identity/v3/users/d78bcab05492474086a2a828a0d802fb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:45.633732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:45.636288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:45.654831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6696-955b-49c1-b02a-ad0f26918f55 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:45.714248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:45.715070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.715355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.715756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] PATH_INFO: `/v3/projects/5a79db86a0cd4054808dc51f6119135d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.716978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a79db86a0cd4054808dc51f6119135d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:45.718873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:45.766824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a79db86a0cd4054808dc51f6119135d', 'request_id': 'req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.774050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a79db86a0cd4054808dc51f6119135d', 'request_id': 'req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.785225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a79db86a0cd4054808dc51f6119135d', 'request_id': 'req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.796821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] The token cache is being invalidate because project 5a79db86a0cd4054808dc51f6119135d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:45.796821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.797100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8aa8e62e-6832-4caa-b2ef-b9772cd7b424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:45.798759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1187/2365] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:45 2022] DELETE /identity/v3/projects/5a79db86a0cd4054808dc51f6119135d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:45.804057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.804535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.804883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.823813 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:45.825098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:45.857703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:45.886638 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1179/2366] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:45.894371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.894665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.894937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.914113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:45.915344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:45.927878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1188/2367] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:45.929710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:45.940104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37324f9-20ac-4f7f-9e6b-ab721fae510b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:45.945708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:45.946723 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.947146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.947470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.948406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:04:45.948718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:45.950425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:45.963286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1180/2368] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:04:45.967503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:45.977897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72cb0d-3f5f-4f27-bba6-5aa1db0801f7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:45.982863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:45.983524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:45.984389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:45.984668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:45.985539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:45.987448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.021042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1189/2369] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:45 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:46.025257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.039860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22e270-034c-418e-b264-09952fc969fa admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.103406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.104117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.104406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.104688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.105936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.107283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.131579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1181/2370] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:46 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:04:46.132856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.139935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:46.143907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357c005-a89c-43f7-8fe5-0c74e5613e2c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.152847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.153594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.153956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.154308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.155116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.156910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.168290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1190/2371] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:46.172244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.182882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdddc8-d966-4485-8470-2a78eddee695 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.187593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e605de3-110d-4d0e-994c-2df26f61729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.188268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e605de3-110d-4d0e-994c-2df26f61729c admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.188553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e605de3-110d-4d0e-994c-2df26f61729c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.188831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e605de3-110d-4d0e-994c-2df26f61729c admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.189554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e605de3-110d-4d0e-994c-2df26f61729c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.191138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e605de3-110d-4d0e-994c-2df26f61729c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.201040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1182/2372] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:46.204881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.215217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072695e5-8964-48da-9275-20d3f3beeed2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.219928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.220812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.221097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.221384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] PATH_INFO: `/v3/projects/a3f4f4c9cdc945f8b5ee9b6ceb862e59/users/8a28d8dd21064ebf83c44950bfa5b63e/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.236415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f4f4c9cdc945f8b5ee9b6ceb862e59, user_id=8a28d8dd21064ebf83c44950bfa5b63e, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.239058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.252003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1191/2373] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:46 2022] PUT /identity/v3/projects/a3f4f4c9cdc945f8b5ee9b6ceb862e59/users/8a28d8dd21064ebf83c44950bfa5b63e/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:46.262573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.262863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.263144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.289819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] MFA Rules not processed for user `8a28d8dd21064ebf83c44950bfa5b63e`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:46.291012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:46.352436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1183/2374] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:46.356954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.417799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee2eb-74d6-4042-90a1-b36c6cce214d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.422437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.423086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.423374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.423658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.424379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.426327 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.450671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1192/2375] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:46 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:46.454574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.465948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d67a42-74d9-4231-8280-fc9cef8ae626 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.498152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:46.523223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.523878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.524188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.524465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.525149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.527048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.546035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1184/2376] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:46 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:46.550031 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.560412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0a8a6-447b-4ae2-84e6-6c0eeeafba7b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.565154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.565812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.566096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.566867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.567623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.569245 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.579904 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1193/2377] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:46.584530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.594858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cdec8-4905-4571-a428-38aa6c171f25 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.599426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.600336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.600621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.600898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] PATH_INFO: `/v3/projects/8d81cb0ff68a4727ad99d6678553fedd/users/99c58de7146e46adabc3bbbe15da2e99/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.615411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d81cb0ff68a4727ad99d6678553fedd, user_id=99c58de7146e46adabc3bbbe15da2e99, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.618079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.631688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1185/2378] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:46 2022] PUT /identity/v3/projects/8d81cb0ff68a4727ad99d6678553fedd/users/99c58de7146e46adabc3bbbe15da2e99/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:46.635474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.646111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9aad6-ce4f-4793-8d82-1984ce8f2cb8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.700918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19d541-2ffe-4a0b-8cbe-3610d79d98e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.701571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d541-2ffe-4a0b-8cbe-3610d79d98e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.701848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d541-2ffe-4a0b-8cbe-3610d79d98e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.702120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19d541-2ffe-4a0b-8cbe-3610d79d98e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.702836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d541-2ffe-4a0b-8cbe-3610d79d98e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.704459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19d541-2ffe-4a0b-8cbe-3610d79d98e6 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.714488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1194/2379] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:46.718627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.728659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c79f9-da5f-47b2-b195-550328346b5a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.733167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.734030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.734309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.734582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] PATH_INFO: `/v3/projects/8d81cb0ff68a4727ad99d6678553fedd/users/99c58de7146e46adabc3bbbe15da2e99/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.736541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d81cb0ff68a4727ad99d6678553fedd, user_id=99c58de7146e46adabc3bbbe15da2e99, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.739148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.749353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1186/2380] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:46 2022] PUT /identity/v3/projects/8d81cb0ff68a4727ad99d6678553fedd/users/99c58de7146e46adabc3bbbe15da2e99/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:46.760788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.761084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.761369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.788220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] MFA Rules not processed for user `99c58de7146e46adabc3bbbe15da2e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:46.789420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:46.817459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:46.857429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1195/2381] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:46.868963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:46.870680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:46.927401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d5780-1549-418a-8618-1fb905367d31 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:46.931088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbe56f-923b-4edc-a049-444d4524405a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:46.931727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe56f-923b-4edc-a049-444d4524405a service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:46.932045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe56f-923b-4edc-a049-444d4524405a service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:46.932325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbe56f-923b-4edc-a049-444d4524405a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:46.941296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe56f-923b-4edc-a049-444d4524405a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:46.943251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbe56f-923b-4edc-a049-444d4524405a service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:46.952566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1187/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:47.328077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:47.385782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07be53-1020-428d-92aa-b2e5a9e7a181 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:47.390323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:47.391186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:47.391471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:47.391747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] PATH_INFO: `/v3/users/8a28d8dd21064ebf83c44950bfa5b63e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:47.392961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a28d8dd21064ebf83c44950bfa5b63e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:47.394898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:47.440206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a28d8dd21064ebf83c44950bfa5b63e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.452081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a28d8dd21064ebf83c44950bfa5b63e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.459488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a28d8dd21064ebf83c44950bfa5b63e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.466500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a28d8dd21064ebf83c44950bfa5b63e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.467125 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a28d8dd21064ebf83c44950bfa5b63e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.473578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1196/2383] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:47 2022] DELETE /identity/v3/users/8a28d8dd21064ebf83c44950bfa5b63e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:47.478049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:47.478510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:47.478632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:47.496592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:47.497766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:47.556160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1188/2384] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:47.565428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:47.566831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:47.612500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:47.625682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6f6cc-2ceb-4203-8c87-1d2adb65bff3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:47.629388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:47.630055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:47.630335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:47.630611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:47.639544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:47.641077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:47.650482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1197/2385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:47.910735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:47.912211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:47.925042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90fa4c-7c92-4d67-b51d-97e592259870 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:47.930215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:47.931083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:47.931364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:47.931652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] PATH_INFO: `/v3/projects/a3f4f4c9cdc945f8b5ee9b6ceb862e59` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:47.932887 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f4f4c9cdc945f8b5ee9b6ceb862e59)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:47.934768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:47.965426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:47.983950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f4f4c9cdc945f8b5ee9b6ceb862e59', 'request_id': 'req-35baad5a-7f5b-4a24-a020-3ad86b2c7114'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.990045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f4f4c9cdc945f8b5ee9b6ceb862e59', 'request_id': 'req-35baad5a-7f5b-4a24-a020-3ad86b2c7114'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:47.998321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f4f4c9cdc945f8b5ee9b6ceb862e59', 'request_id': 'req-35baad5a-7f5b-4a24-a020-3ad86b2c7114'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.008676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] The token cache is being invalidate because project a3f4f4c9cdc945f8b5ee9b6ceb862e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:48.008960 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.009574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.011103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1189/2386] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:47 2022] DELETE /identity/v3/projects/a3f4f4c9cdc945f8b5ee9b6ceb862e59 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:48.015302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:48.025467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab772a30-ff14-4754-b5ce-57124eb81f1f service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:48.080736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:48.081600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.081879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.082816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] PATH_INFO: `/v3/users/99c58de7146e46adabc3bbbe15da2e99` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.084005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c58de7146e46adabc3bbbe15da2e99)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:48.085913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:48.130590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c58de7146e46adabc3bbbe15da2e99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.142042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c58de7146e46adabc3bbbe15da2e99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.150209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c58de7146e46adabc3bbbe15da2e99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.157020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c58de7146e46adabc3bbbe15da2e99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.157639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-35be4dba-228e-423d-b608-ae6190c0d3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c58de7146e46adabc3bbbe15da2e99'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.163797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1198/2387] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:48 2022] DELETE /identity/v3/users/99c58de7146e46adabc3bbbe15da2e99 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:48.493452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:48.495219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:48.509123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baad5a-7f5b-4a24-a020-3ad86b2c7114 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:48.573295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:48.574248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.574502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.574780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] PATH_INFO: `/v3/projects/8d81cb0ff68a4727ad99d6678553fedd` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.576001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d81cb0ff68a4727ad99d6678553fedd)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:48.577915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:48.621670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d81cb0ff68a4727ad99d6678553fedd', 'request_id': 'req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.627463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d81cb0ff68a4727ad99d6678553fedd', 'request_id': 'req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.635010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d81cb0ff68a4727ad99d6678553fedd', 'request_id': 'req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.644968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] The token cache is being invalidate because project 8d81cb0ff68a4727ad99d6678553fedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:48.645249 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.645872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5add9cd8-abda-4bcd-97be-a7c1f6df2b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:48.647387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1190/2388] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:48 2022] DELETE /identity/v3/projects/8d81cb0ff68a4727ad99d6678553fedd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:48.652758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.653205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.653329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.670582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:48.671777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:48.732976 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1199/2389] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:48.741240 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.741519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.741794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.760245 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:48.761439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:48.769886 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1191/2390] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:48.774115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:48.793306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c790f23-7352-432f-8f30-8095d3e93e3b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:48.798017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:48.798677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.798962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.799242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.800027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:04:48.800344 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:48.802442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:48.803957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:48.817293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1200/2391] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:04:48.821673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:48.832412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e922ef3-8560-4e60-afda-817e414e39ec None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:48.839880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:48.840591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.840966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.841402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.842312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:48.844257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:48.871195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1192/2392] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:48 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:48.875553 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:48.885674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c4a76-e1ed-4754-ae6a-034a598ba393 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:48.942583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:48.943253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.943546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.943827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.944564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:48.946485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:48.965802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1201/2393] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:48 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:48.969980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:48.981136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb1fd-ae9c-4f44-a051-21de1322b8b0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:48.985764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:48.986417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:48.986702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:48.986984 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:48.987711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:48.989941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:49.000555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1193/2394] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:49.004468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:49.014210 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58664-d2e0-4a9a-aa78-ff738db3d97a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:49.020023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41c167-a35d-4769-9fc7-0f6872375ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:49.020676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c167-a35d-4769-9fc7-0f6872375ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:49.020958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c167-a35d-4769-9fc7-0f6872375ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:49.021231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41c167-a35d-4769-9fc7-0f6872375ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:49.021957 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c167-a35d-4769-9fc7-0f6872375ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:49.023544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41c167-a35d-4769-9fc7-0f6872375ee0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:49.033739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1202/2395] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:49.038778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:49.045516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:49.051491 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188a3d-4f3c-4721-ac7b-5239aceb3d58 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:49.057709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:49.059552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:49.059840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:49.060160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] PATH_INFO: `/v3/projects/3e8a63bbf4fd476e837283a19ff8bdc6/users/ed59f4962a0b4aecbabef629b026c4e9/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:49.081463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8a63bbf4fd476e837283a19ff8bdc6, user_id=ed59f4962a0b4aecbabef629b026c4e9, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:49.084204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:49.100234 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1194/2396] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:49 2022] PUT /identity/v3/projects/3e8a63bbf4fd476e837283a19ff8bdc6/users/ed59f4962a0b4aecbabef629b026c4e9/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:49.110420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:49.110707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:49.110987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:49.137937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] MFA Rules not processed for user `ed59f4962a0b4aecbabef629b026c4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:49.139113 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:49.203925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1203/2397] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:49.214967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:49.216771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:49.272998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c589324-db3f-4b16-b9e8-2a62aeafde3a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:49.276663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebd7f2-03f5-4767-8192-3aadbbf04709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:49.277293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebd7f2-03f5-4767-8192-3aadbbf04709 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:49.277573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebd7f2-03f5-4767-8192-3aadbbf04709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:49.277848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebd7f2-03f5-4767-8192-3aadbbf04709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:49.285989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebd7f2-03f5-4767-8192-3aadbbf04709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:49.287417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebd7f2-03f5-4767-8192-3aadbbf04709 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:49.296281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1195/2398] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:56.659639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:56.723962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367be0-ebaa-4727-9a1d-9f704769b8d3 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:56.728466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:56.729329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:56.729603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:56.729881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] PATH_INFO: `/v3/users/ed59f4962a0b4aecbabef629b026c4e9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:56.731074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed59f4962a0b4aecbabef629b026c4e9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:56.733021 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:56.735543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:56.780577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed59f4962a0b4aecbabef629b026c4e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:56.793096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed59f4962a0b4aecbabef629b026c4e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:56.800253 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed59f4962a0b4aecbabef629b026c4e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:56.807098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed59f4962a0b4aecbabef629b026c4e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:56.807720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed59f4962a0b4aecbabef629b026c4e9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:56.813562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1204/2399] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:04:56 2022] DELETE /identity/v3/users/ed59f4962a0b4aecbabef629b026c4e9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:56.818154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:56.818635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:56.818786 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:56.835814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:56.837037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:56.895582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1196/2400] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:56.905272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:56.906629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:56.964394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97703fe-2781-42d4-a1da-3c3ae3a90133 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:56.968152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f186e13-894f-49a2-987c-80ce9f3febef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:56.968878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f186e13-894f-49a2-987c-80ce9f3febef service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:56.969202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f186e13-894f-49a2-987c-80ce9f3febef service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:56.969486 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f186e13-894f-49a2-987c-80ce9f3febef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:56.979719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f186e13-894f-49a2-987c-80ce9f3febef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:56.981182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f186e13-894f-49a2-987c-80ce9f3febef service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:56.990838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1205/2401] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:04:57.260498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.261970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:57.278555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4b0b-dc63-45d3-a9fa-ed4e08949666 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.283962 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.285407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.285694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.286158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] PATH_INFO: `/v3/projects/3e8a63bbf4fd476e837283a19ff8bdc6` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.287408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8a63bbf4fd476e837283a19ff8bdc6)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.289530 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.338105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8a63bbf4fd476e837283a19ff8bdc6', 'request_id': 'req-07e86e66-71d2-4336-bb96-fd75e8653bc2'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:57.344235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8a63bbf4fd476e837283a19ff8bdc6', 'request_id': 'req-07e86e66-71d2-4336-bb96-fd75e8653bc2'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:57.351505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8a63bbf4fd476e837283a19ff8bdc6', 'request_id': 'req-07e86e66-71d2-4336-bb96-fd75e8653bc2'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:57.361517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] The token cache is being invalidate because project 3e8a63bbf4fd476e837283a19ff8bdc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:04:57.361803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:57.362421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-07e86e66-71d2-4336-bb96-fd75e8653bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:04:57.363991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1197/2402] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:04:57 2022] DELETE /identity/v3/projects/3e8a63bbf4fd476e837283a19ff8bdc6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:04:57.369033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.369331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.369610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.387397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:57.388616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:57.446694 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1206/2403] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:57.454039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.454340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.454625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.467666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:57.474344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:57.476767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:57.486277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1198/2404] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:57.491264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.500977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff775a1-2ab8-4a61-9165-2253926b5fbb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.506209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.506860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.507146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.507457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.508234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:04:57.508532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.510120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.521794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1207/2405] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:04:57.525876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.535575 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12575e-15bd-4739-af0d-299c6084dbe2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.540624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.541266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.541552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.541828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.542510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.544457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.580227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1199/2406] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:04:57 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:57.584291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.594294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f36352-249a-44c1-ba93-0c73da9486f8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.601964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:04:57.651943 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.652636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.652925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.653206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.653890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.655835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.674305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1208/2407] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:04:57 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:04:57.678836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.689130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7e8df-2c41-4a1f-8174-2a5ec7b90c06 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.694297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.694942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.695225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.695501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.696268 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.697913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.707607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1200/2408] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:57.711325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.721090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14baab3-d75a-48e8-ba4c-7b24b725c155 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.725741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032e46e-018b-4a47-b735-401a7272301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.726388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e46e-018b-4a47-b735-401a7272301f admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.726675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e46e-018b-4a47-b735-401a7272301f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.726960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032e46e-018b-4a47-b735-401a7272301f admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.727687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032e46e-018b-4a47-b735-401a7272301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.729295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032e46e-018b-4a47-b735-401a7272301f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.739852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1209/2409] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:04:57.743857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.753598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5dfe62-92c4-4db6-bfe3-7bf17381e6b2 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.758768 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.759632 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.759914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.760224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] PATH_INFO: `/v3/projects/b899663d078945d89dd5df8c049413c6/users/82d8ec09fb4a48a58e79847a59c25b01/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.776429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=b899663d078945d89dd5df8c049413c6, user_id=82d8ec09fb4a48a58e79847a59c25b01, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.779213 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.794380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1201/2410] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:04:57 2022] PUT /identity/v3/projects/b899663d078945d89dd5df8c049413c6/users/82d8ec09fb4a48a58e79847a59c25b01/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:04:57.805137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc3afa-5bbb-4bc4-9f74-457dfab0a8ef None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.805429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc3afa-5bbb-4bc4-9f74-457dfab0a8ef None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.805714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc3afa-5bbb-4bc4-9f74-457dfab0a8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.834206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b0cc3afa-5bbb-4bc4-9f74-457dfab0a8ef None None] MFA Rules not processed for user `82d8ec09fb4a48a58e79847a59c25b01`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:04:57.835419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b0cc3afa-5bbb-4bc4-9f74-457dfab0a8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:57.899472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1210/2411] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:04:57.912334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:04:57.914285 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:04:57.973682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0511dd-60c0-4e02-821b-0271d82c6cab admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:04:57.977335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:04:57.977976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:04:57.978258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:04:57.978536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:04:57.986703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:04:57.988800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:04:57.998014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1202/2412] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:04:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:07.896274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:07.993932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:10.577638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:10.578144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:10.578322 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:10.597742 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:10.598986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:10.656072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1211/2413] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:10.704040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:10.705454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:10.775330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e78c3-c363-440f-884c-c793068cc1c0 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:10.780428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653d5d9-9904-4442-93b9-2265d59558a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:10.781074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d5d9-9904-4442-93b9-2265d59558a9 service swift] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:10.781357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d5d9-9904-4442-93b9-2265d59558a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:10.781636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d5d9-9904-4442-93b9-2265d59558a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:10.790174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653d5d9-9904-4442-93b9-2265d59558a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:10.791744 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653d5d9-9904-4442-93b9-2265d59558a9 service swift] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:10.800037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1203/2414] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:18.801167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:18.901419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957babb-ada7-4d20-83f1-0e9e74ea9e47 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:18.906472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:18.908119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:18.908527 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:18.908760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] PATH_INFO: `/v3/users/82d8ec09fb4a48a58e79847a59c25b01` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:18.910084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d8ec09fb4a48a58e79847a59c25b01)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:18.912014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:18.968862 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d8ec09fb4a48a58e79847a59c25b01'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:18.986320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d8ec09fb4a48a58e79847a59c25b01'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:18.996326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d8ec09fb4a48a58e79847a59c25b01'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.005544 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d8ec09fb4a48a58e79847a59c25b01'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.006313 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d8ec09fb4a48a58e79847a59c25b01'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.013612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1212/2415] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:18 2022] DELETE /identity/v3/users/82d8ec09fb4a48a58e79847a59c25b01 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:19.018226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:19.018727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:19.018810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:19.036779 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:19.038347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:19.129464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1204/2416] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:19.141232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:19.143655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:19.215721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:19.283258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3e46e-3660-4ffa-a566-3506bee52690 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:19.287378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3d8d6-0646-4662-9ba0-623a6be52a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:19.289911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d8d6-0646-4662-9ba0-623a6be52a2f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:19.289911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d8d6-0646-4662-9ba0-623a6be52a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:19.289911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3d8d6-0646-4662-9ba0-623a6be52a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:19.311784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3d8d6-0646-4662-9ba0-623a6be52a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:19.313383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3d8d6-0646-4662-9ba0-623a6be52a2f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:19.339856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1213/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:19.718628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:19.721910 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:19.734742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b4e9c-0afc-4f5f-9b31-d7334ec3da8b None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:19.740396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:19.741745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:19.742195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:19.742639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] PATH_INFO: `/v3/projects/b899663d078945d89dd5df8c049413c6` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:19.743843 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b899663d078945d89dd5df8c049413c6)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:19.745788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:19.813738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b899663d078945d89dd5df8c049413c6', 'request_id': 'req-aee05585-0dc9-4400-96e7-5e2f14dc0838'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.823057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b899663d078945d89dd5df8c049413c6', 'request_id': 'req-aee05585-0dc9-4400-96e7-5e2f14dc0838'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.834906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b899663d078945d89dd5df8c049413c6', 'request_id': 'req-aee05585-0dc9-4400-96e7-5e2f14dc0838'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.847570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] The token cache is being invalidate because project b899663d078945d89dd5df8c049413c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:05:19.848194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.849063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-aee05585-0dc9-4400-96e7-5e2f14dc0838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:19.851722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1205/2418] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:05:19 2022] DELETE /identity/v3/projects/b899663d078945d89dd5df8c049413c6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:19.856447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:19.856967 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:19.857119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:19.889075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:19.890397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:19.953442 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1214/2419] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:05:19.962471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:19.962694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:19.962968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:19.980852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:19.982044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:19.989849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1206/2420] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:19.994271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.004517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6a315-da43-4d0b-8bbf-f75ddafb9e11 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.015685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.016406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.016689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.016960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.017698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:05:20.018006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.019629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.035462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1215/2421] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:05:20.036677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.045988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84322f8-dccc-4379-9581-2d4572166787 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.050578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.051237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.051518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.051789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.052609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.054521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.057692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:20.081132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1207/2422] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:05:20 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:05:20.085127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.095960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a601fa-d7d7-4c8d-a2aa-8047ba585d8a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.151150 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.151804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.152117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.152394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.153084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.154978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.174597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1216/2423] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:05:20 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:05:20.178653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.189524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c43d-2557-473c-9f1a-7188e6557b9e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.194252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.194956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.195238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.195512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.196265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.198122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.207995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1208/2424] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:20.211794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.221842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f10f5-bd91-44ae-a93a-06cc1c642a77 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.226925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295b01e-b807-4ec4-9b41-fae9bc692c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.227570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b01e-b807-4ec4-9b41-fae9bc692c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.228283 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b01e-b807-4ec4-9b41-fae9bc692c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.228570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295b01e-b807-4ec4-9b41-fae9bc692c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.229299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295b01e-b807-4ec4-9b41-fae9bc692c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.230889 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295b01e-b807-4ec4-9b41-fae9bc692c0b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.241266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1217/2425] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:20.245771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.255495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62e2e18-fea7-4fe5-82eb-2a8f73403a2e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.260119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.260988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.261271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.261548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] PATH_INFO: `/v3/projects/6b519e8f90c743ad9525c63e42e896ff/users/46a346c0dcf84933a0a6e62efeab82f9/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.276170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b519e8f90c743ad9525c63e42e896ff, user_id=46a346c0dcf84933a0a6e62efeab82f9, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.278796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.291580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1209/2426] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:20 2022] PUT /identity/v3/projects/6b519e8f90c743ad9525c63e42e896ff/users/46a346c0dcf84933a0a6e62efeab82f9/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:05:20.301618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.301917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.302235 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.329416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] MFA Rules not processed for user `46a346c0dcf84933a0a6e62efeab82f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:20.330628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:20.351167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:20.397305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1218/2427] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:05:20.409098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:20.410775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:20.471541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778a6b2-c04e-463f-be58-e61f523e35c9 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:20.475248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75505f-f604-4a15-be6d-674ad94c6d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:20.475838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75505f-f604-4a15-be6d-674ad94c6d0b service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:20.476821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75505f-f604-4a15-be6d-674ad94c6d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:20.477103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75505f-f604-4a15-be6d-674ad94c6d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:20.485360 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75505f-f604-4a15-be6d-674ad94c6d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:20.486766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75505f-f604-4a15-be6d-674ad94c6d0b service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:20.495703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1210/2428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:23.017479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:23.081097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00240ff3-0034-4245-a2a7-ce5fbaa773cb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:23.085755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:23.086630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:23.091571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:23.091571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] PATH_INFO: `/v3/users/46a346c0dcf84933a0a6e62efeab82f9` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:23.091571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a346c0dcf84933a0a6e62efeab82f9)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:23.091571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:23.143305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a346c0dcf84933a0a6e62efeab82f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.157933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a346c0dcf84933a0a6e62efeab82f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.167319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a346c0dcf84933a0a6e62efeab82f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.176720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a346c0dcf84933a0a6e62efeab82f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.177460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a346c0dcf84933a0a6e62efeab82f9'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.185320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1219/2429] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:23 2022] DELETE /identity/v3/users/46a346c0dcf84933a0a6e62efeab82f9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:23.189809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:23.190311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:23.190483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:23.210970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:23.212544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:23.292991 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1211/2430] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:23.300704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:23.302999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:23.362581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:23.376241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e8330-489a-4c90-a47c-d76055000384 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:23.382080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:23.383017 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:23.383307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:23.383597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:23.396421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:23.398990 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:23.411271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1220/2431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:05:23.739555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:23.741391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:23.753597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40c44b-8ef9-42dd-b227-da06ab55d8e0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:23.760035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:23.760921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:23.761194 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:23.761468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] PATH_INFO: `/v3/projects/6b519e8f90c743ad9525c63e42e896ff` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:23.762657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b519e8f90c743ad9525c63e42e896ff)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:23.764627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:23.812229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:23.813719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b519e8f90c743ad9525c63e42e896ff', 'request_id': 'req-efc8c894-85d6-443d-b5d3-d2d265b3f28f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.822023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b519e8f90c743ad9525c63e42e896ff', 'request_id': 'req-efc8c894-85d6-443d-b5d3-d2d265b3f28f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.830267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b519e8f90c743ad9525c63e42e896ff', 'request_id': 'req-efc8c894-85d6-443d-b5d3-d2d265b3f28f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.841494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] The token cache is being invalidate because project 6b519e8f90c743ad9525c63e42e896ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:05:23.841800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.842794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-efc8c894-85d6-443d-b5d3-d2d265b3f28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:23.844380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1212/2432] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:05:23 2022] DELETE /identity/v3/projects/6b519e8f90c743ad9525c63e42e896ff => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:26.058871 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:26.067833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e71115-fea7-45af-9ee7-cbba50d9c8de service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:26.133601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:26.134395 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.134678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.134952 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.137147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:26.146509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:26.148008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438298f-4264-4355-adad-47342af23ce9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:26.155926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1221/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:26.265626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a595-d155-456c-b38a-38a5d7f9c43c None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.266324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a595-d155-456c-b38a-38a5d7f9c43c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.266586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a595-d155-456c-b38a-38a5d7f9c43c None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.268536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1213/2434] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 10:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:05:26.275653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c17462-6756-475b-83c7-2c8dc67063a9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.275999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c17462-6756-475b-83c7-2c8dc67063a9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.276351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c17462-6756-475b-83c7-2c8dc67063a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.303027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-80c17462-6756-475b-83c7-2c8dc67063a9 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:26.304291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-80c17462-6756-475b-83c7-2c8dc67063a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:26.376323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1222/2435] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:26.389340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a595-d155-456c-b38a-38a5d7f9c43c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:26.391127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a9e9a595-d155-456c-b38a-38a5d7f9c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:26.484290 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a595-d155-456c-b38a-38a5d7f9c43c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:26.487896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce640f-5821-4972-9b69-4d2497a00863 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:26.488572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce640f-5821-4972-9b69-4d2497a00863 service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.488854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce640f-5821-4972-9b69-4d2497a00863 service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.489130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce640f-5821-4972-9b69-4d2497a00863 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.500098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce640f-5821-4972-9b69-4d2497a00863 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:26.501578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce640f-5821-4972-9b69-4d2497a00863 service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:26.513178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1214/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:26.582671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b52c4-538b-4b0d-b9f0-93ea15ac2200 None None] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.582970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b52c4-538b-4b0d-b9f0-93ea15ac2200 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.583284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b52c4-538b-4b0d-b9f0-93ea15ac2200 None None] PATH_INFO: `/` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.584797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1223/2437] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 10:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:05:26.590332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3f1e-e50e-438f-a52c-f6494405261d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.590620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3f1e-e50e-438f-a52c-f6494405261d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.590895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c3f1e-e50e-438f-a52c-f6494405261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.609331 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-737c3f1e-e50e-438f-a52c-f6494405261d None None] MFA Rules not processed for user `1ea057364d054564b4c44f7a5d60f94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:26.610457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-737c3f1e-e50e-438f-a52c-f6494405261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:26.617708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1215/2438] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:05:26.633818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b52c4-538b-4b0d-b9f0-93ea15ac2200 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:26.635541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-875b52c4-538b-4b0d-b9f0-93ea15ac2200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:26.649345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b52c4-538b-4b0d-b9f0-93ea15ac2200 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:26.652893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e1cbb-3516-4381-9d7b-0c0d2e92e89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:26.653529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1cbb-3516-4381-9d7b-0c0d2e92e89c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.653814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1cbb-3516-4381-9d7b-0c0d2e92e89c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.654092 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1cbb-3516-4381-9d7b-0c0d2e92e89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.661174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1cbb-3516-4381-9d7b-0c0d2e92e89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:26.662766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e1cbb-3516-4381-9d7b-0c0d2e92e89c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:26.671075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1224/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:26.752044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cf69-df80-484f-95b8-63e1eac2aafb None None] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.752336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cf69-df80-484f-95b8-63e1eac2aafb None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.752616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2cf69-df80-484f-95b8-63e1eac2aafb None None] PATH_INFO: `/` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.753996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1216/2440] 10.222.0.36 () {54 vars in 921 bytes} [Tue Jun 21 10:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:05:26.759371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3f601-9f27-481e-80d7-58d77190cdf6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.759658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3f601-9f27-481e-80d7-58d77190cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.759938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3f601-9f27-481e-80d7-58d77190cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.779326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f5c3f601-9f27-481e-80d7-58d77190cdf6 None None] MFA Rules not processed for user `947e9ae8d1a44654b3c294b849912707`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:26.780558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f5c3f601-9f27-481e-80d7-58d77190cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:26.789769 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1225/2441] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Jun 21 10:05:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:26.800141 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cf69-df80-484f-95b8-63e1eac2aafb None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:26.811000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2cf69-df80-484f-95b8-63e1eac2aafb None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:26.814558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:26.815189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:26.815487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:26.815764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:26.827388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:26.829166 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:26.843512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1217/2442] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:28.555674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:28.556169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:28.556270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:28.573735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:28.574925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:28.628460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1226/2443] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:05:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:28.640081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:28.641451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:28.716092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8940c-34c5-47d7-a182-8b23b214a386 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:28.721734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:28.722493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:28.722845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:28.723212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:28.732400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:28.734010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:28.743075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1218/2444] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:05:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:30.231335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:30.237194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:30.241918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b583fdf-43fc-40c8-b517-c2fce4b7b3fc None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:30.245887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:30.246536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:30.246847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:30.247133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:30.248982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:30.319776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:30.321287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:30.332248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1227/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:34.367650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:34.369799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:34.392826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10bd6-c859-40af-9533-56a36e20fc6a service swift] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:34.397343 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:34.398781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:34.399063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:34.399339 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] PATH_INFO: `/v3/users/1fde108762d645bc9c5c5791dfe646a0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:34.400548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fde108762d645bc9c5c5791dfe646a0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:34.402462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:34.426367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:34.454482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fde108762d645bc9c5c5791dfe646a0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.470311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fde108762d645bc9c5c5791dfe646a0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.471169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fde108762d645bc9c5c5791dfe646a0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.479017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fde108762d645bc9c5c5791dfe646a0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.486557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c639d3b1-a679-4376-8ffa-213e58a42b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fde108762d645bc9c5c5791dfe646a0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.493927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1219/2446] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:34 2022] DELETE /identity/v3/users/1fde108762d645bc9c5c5791dfe646a0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:34.684249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:34.700832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5cf08-d275-4b2b-82e5-bda6d828c045 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:34.772504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:34.773929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:34.774206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:34.774478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] PATH_INFO: `/v3/projects/c8dc9e553cda4326a9dd10c3e0a35546` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:34.775810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dc9e553cda4326a9dd10c3e0a35546)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:34.778188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:34.828018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dc9e553cda4326a9dd10c3e0a35546', 'request_id': 'req-4b5eca41-2801-45ba-8f80-5218c46f2cce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.836064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dc9e553cda4326a9dd10c3e0a35546', 'request_id': 'req-4b5eca41-2801-45ba-8f80-5218c46f2cce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.845006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dc9e553cda4326a9dd10c3e0a35546', 'request_id': 'req-4b5eca41-2801-45ba-8f80-5218c46f2cce'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.860406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] The token cache is being invalidate because project c8dc9e553cda4326a9dd10c3e0a35546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:05:34.860985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.861378 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4b5eca41-2801-45ba-8f80-5218c46f2cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:34.864535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1228/2447] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:05:34 2022] DELETE /identity/v3/projects/c8dc9e553cda4326a9dd10c3e0a35546 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:34.871292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:34.871583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:34.871873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:34.893012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:34.894338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:34.987433 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1220/2448] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:34.995275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:34.995571 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:34.995835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.020481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:35.021722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:35.041352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1229/2449] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:35.042172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.052448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ac623-1cb2-4285-9368-17240e6e74e3 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.057566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.058233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.058520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.058799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.068717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:05:35.069421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.072217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.089201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1221/2450] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:05:35.100564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.110986 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579596b6-a1f6-49e3-a2c9-93a46ee08ca1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.116851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.117522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.117811 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.118089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.118810 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.120866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.144809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:35.155034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1230/2451] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:05:35 2022] POST /identity/v3/projects => generated 355 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:05:35.159280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.176282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9108c-1801-4059-9f15-2457166db1be admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.263203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.263986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.264396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.264749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.265627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.268145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.300262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1222/2452] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:05:35 2022] POST /identity/v3/users => generated 278 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:05:35.301581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.313649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856fa1d-f2d9-428a-9769-674f302f2e5b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.318522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.319214 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.319476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.320407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.321143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.322921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.340793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1231/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:35.342020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.353359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901e0d1-cc26-444a-8257-a6442a231083 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.360624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3f09b-7727-4c50-a4b7-675dfaec4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.361310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3f09b-7727-4c50-a4b7-675dfaec4fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.361602 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3f09b-7727-4c50-a4b7-675dfaec4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.361888 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3f09b-7727-4c50-a4b7-675dfaec4fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.362706 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3f09b-7727-4c50-a4b7-675dfaec4fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.364469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3f09b-7727-4c50-a4b7-675dfaec4fc0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.381563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1223/2454] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:35.383140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.395120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ed013-ff95-400b-855d-3c28a0d7b4ab admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.412802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.413774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.414048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.414324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] PATH_INFO: `/v3/projects/10c145d0a8b2439e94febac39ca61e4d/users/af3c389aa69f4ac4ac116f3d18538993/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.431668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c145d0a8b2439e94febac39ca61e4d, user_id=af3c389aa69f4ac4ac116f3d18538993, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.434586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.449839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1232/2455] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:35 2022] PUT /identity/v3/projects/10c145d0a8b2439e94febac39ca61e4d/users/af3c389aa69f4ac4ac116f3d18538993/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:35.460884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49404-8538-4761-8613-170f7b04863a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.461158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49404-8538-4761-8613-170f7b04863a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.461558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc49404-8538-4761-8613-170f7b04863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.475499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:35.494232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6dc49404-8538-4761-8613-170f7b04863a None None] MFA Rules not processed for user `af3c389aa69f4ac4ac116f3d18538993`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:35.495644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6dc49404-8538-4761-8613-170f7b04863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:35.572804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1224/2456] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:35.577244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.646678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c90d9-66e3-47a1-a2b3-3ab596ee23b4 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.652617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.654277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.654619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.654955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.655717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.657688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.690099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1233/2457] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:05:35 2022] POST /identity/v3/projects => generated 355 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:05:35.692696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49404-8538-4761-8613-170f7b04863a None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.705872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc49404-8538-4761-8613-170f7b04863a None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.766736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.767509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.767881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.768250 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.769003 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.770993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.793870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1225/2458] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:05:35 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:05:35.797077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.808832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec7ecb-b1db-437c-8e3a-a2480f39adfb admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.813816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.814586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.815005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.815354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.816207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.817921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.830834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1234/2459] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:05:35.834156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.845145 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772205b-b0d6-483b-828c-c4b9df3aedd7 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.849963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.850890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.851173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.851452 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] PATH_INFO: `/v3/projects/1740718551764c09a070d827ce662b95/users/2e8d976d3b854b7ea07ddd26f02eb4cc/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.867619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1740718551764c09a070d827ce662b95, user_id=2e8d976d3b854b7ea07ddd26f02eb4cc, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.870338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:35.885374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1226/2460] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:35 2022] PUT /identity/v3/projects/1740718551764c09a070d827ce662b95/users/2e8d976d3b854b7ea07ddd26f02eb4cc/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:35.889447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:35.900803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c179f72-4f52-4a9d-a03d-b88f8f52332b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:35.987118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7db19c-dcc1-4d90-8000-831b4a561752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:35.988628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7db19c-dcc1-4d90-8000-831b4a561752 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:35.989080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7db19c-dcc1-4d90-8000-831b4a561752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:35.989933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7db19c-dcc1-4d90-8000-831b4a561752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:35.991367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7db19c-dcc1-4d90-8000-831b4a561752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:35.994211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7db19c-dcc1-4d90-8000-831b4a561752 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:36.005994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1235/2461] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:36.010193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:36.020767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0aac0-3886-4e9f-9760-d56c7580d979 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:36.026075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:36.027046 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:36.027340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:36.027643 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] PATH_INFO: `/v3/projects/1740718551764c09a070d827ce662b95/users/2e8d976d3b854b7ea07ddd26f02eb4cc/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:36.030162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1740718551764c09a070d827ce662b95, user_id=2e8d976d3b854b7ea07ddd26f02eb4cc, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:36.032972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:36.046086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1227/2462] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:36 2022] PUT /identity/v3/projects/1740718551764c09a070d827ce662b95/users/2e8d976d3b854b7ea07ddd26f02eb4cc/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:36.055857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:36.056471 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:36.057120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:36.086424 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] MFA Rules not processed for user `2e8d976d3b854b7ea07ddd26f02eb4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:36.087557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:36.112087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:36.164236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1236/2463] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:36 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:05:36.176270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:36.188050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:36.252302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:36.260084 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827416e-cea0-486f-bc27-a36ec2572eb2 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:36.265423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5efd77-830d-4153-bbf7-33e13191ae58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:36.266206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5efd77-830d-4153-bbf7-33e13191ae58 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:36.266623 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5efd77-830d-4153-bbf7-33e13191ae58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:36.266979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5efd77-830d-4153-bbf7-33e13191ae58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:36.277889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5efd77-830d-4153-bbf7-33e13191ae58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:36.279382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5efd77-830d-4153-bbf7-33e13191ae58 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:36.289152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1228/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:36.365281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:36.376905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa057f4-558a-4483-90df-9e6686934858 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:36.380717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:36.381426 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:36.381849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:36.382803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:36.443764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:36.445336 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:36.459049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1237/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:44.622783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117847e6-9767-4e7a-8e98-62a84930e756 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:44.623277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117847e6-9767-4e7a-8e98-62a84930e756 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:44.623406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117847e6-9767-4e7a-8e98-62a84930e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:44.653061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-117847e6-9767-4e7a-8e98-62a84930e756 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:44.654160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-117847e6-9767-4e7a-8e98-62a84930e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:44.731364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1229/2466] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 10:05:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:44.745509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:44.746966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:44.819075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f37dd-cc14-4413-bf23-f77b65b697fb service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:44.824186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:44.824830 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:44.825176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:44.825457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:44.833732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:44.835296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:44.843247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1238/2467] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:05:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:05:48.953035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a358-f095-4801-a681-8ffa65f2b5ad None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:48.953535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a358-f095-4801-a681-8ffa65f2b5ad None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:48.953635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a358-f095-4801-a681-8ffa65f2b5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:48.971424 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a343a358-f095-4801-a681-8ffa65f2b5ad None None] MFA Rules not processed for user `b51e11f068d948a889871ce53ce29ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:48.972649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a343a358-f095-4801-a681-8ffa65f2b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:49.035418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1230/2468] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:51.381455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:51.432425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:51.446928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af0fb3-ba8e-44ef-9835-229c024880ba service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:51.451564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:51.452479 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:51.452763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:51.453043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] PATH_INFO: `/v3/users/af3c389aa69f4ac4ac116f3d18538993` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:51.454259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3c389aa69f4ac4ac116f3d18538993)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:51.456206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:51.509455 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3c389aa69f4ac4ac116f3d18538993'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:51.521644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3c389aa69f4ac4ac116f3d18538993'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:51.531356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3c389aa69f4ac4ac116f3d18538993'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:51.539709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3c389aa69f4ac4ac116f3d18538993'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:51.540399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3c389aa69f4ac4ac116f3d18538993'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:51.547197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1239/2469] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:51 2022] DELETE /identity/v3/users/af3c389aa69f4ac4ac116f3d18538993 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:51.551789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:51.552326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:51.552609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:51.571479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:51.572860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:51.637098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1231/2470] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:51.647319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:51.648925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:51.731841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdab4e-42e0-4a18-a087-b67551891d68 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:51.736349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:51.737085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:51.737369 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:51.737645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:51.749878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:51.751569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:51.764224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1240/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:05:52.438532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:52.440654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:52.459014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d59c7-f8da-4f96-8054-29e50525a2e0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:52.465677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:52.466489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:52.466769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:52.467091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] PATH_INFO: `/v3/projects/10c145d0a8b2439e94febac39ca61e4d` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:52.468379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c145d0a8b2439e94febac39ca61e4d)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:52.470909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:52.522925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:52.535153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c145d0a8b2439e94febac39ca61e4d', 'request_id': 'req-c67d15f3-1505-4fd6-9c1a-245e0c78d556'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.542574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c145d0a8b2439e94febac39ca61e4d', 'request_id': 'req-c67d15f3-1505-4fd6-9c1a-245e0c78d556'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.551096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c145d0a8b2439e94febac39ca61e4d', 'request_id': 'req-c67d15f3-1505-4fd6-9c1a-245e0c78d556'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.562842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] The token cache is being invalidate because project 10c145d0a8b2439e94febac39ca61e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:05:52.563407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.563752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.565725 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1232/2472] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:05:52 2022] DELETE /identity/v3/projects/10c145d0a8b2439e94febac39ca61e4d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:52.570453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:52.584170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4cbd-09ad-4026-b50e-9a2b5955b510 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:52.659230 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:52.660503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:52.660881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:52.661799 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] PATH_INFO: `/v3/users/2e8d976d3b854b7ea07ddd26f02eb4cc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:52.663396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8d976d3b854b7ea07ddd26f02eb4cc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:52.665687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:52.689921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:52.785381 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8d976d3b854b7ea07ddd26f02eb4cc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.808121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8d976d3b854b7ea07ddd26f02eb4cc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.820469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8d976d3b854b7ea07ddd26f02eb4cc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.831783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8d976d3b854b7ea07ddd26f02eb4cc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.833172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a8daad86-c137-44ff-b7a1-9a24e270662e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8d976d3b854b7ea07ddd26f02eb4cc'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:52.842954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1241/2473] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:52 2022] DELETE /identity/v3/users/2e8d976d3b854b7ea07ddd26f02eb4cc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:53.360097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.361709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:53.395034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d15f3-1505-4fd6-9c1a-245e0c78d556 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.466152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.467299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.467732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.468186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] PATH_INFO: `/v3/projects/1740718551764c09a070d827ce662b95` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.469711 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1740718551764c09a070d827ce662b95)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.471630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:53.528102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1740718551764c09a070d827ce662b95', 'request_id': 'req-57e44f00-7948-44a5-b096-1feef784a93b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:53.535862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1740718551764c09a070d827ce662b95', 'request_id': 'req-57e44f00-7948-44a5-b096-1feef784a93b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:53.546528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1740718551764c09a070d827ce662b95', 'request_id': 'req-57e44f00-7948-44a5-b096-1feef784a93b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:53.559114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] The token cache is being invalidate because project 1740718551764c09a070d827ce662b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:05:53.559404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:53.560111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-57e44f00-7948-44a5-b096-1feef784a93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:53.561738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1233/2474] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:05:53 2022] DELETE /identity/v3/projects/1740718551764c09a070d827ce662b95 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:53.566911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.567202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.567487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.586825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:53.588105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:53.651577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1242/2475] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:53.659524 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.660069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.660190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.679906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:53.681181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:53.689368 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1234/2476] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:53.693707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.704459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185e438-e801-4d54-b087-4ca4d658f6a8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.709141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.709813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.710702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.710978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.711708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:05:53.712039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.713645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:53.726249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1243/2477] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:05:53.730525 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.740073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d622d-aaa1-4bd4-a161-483f2f106221 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.745087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.745750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.746037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.746316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.747044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.749008 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:53.777465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1235/2478] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:05:53 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:05:53.781642 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.792121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c2f3-92d7-4107-a822-16228198dc17 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.849903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.850606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.850892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.851201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.851928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.853873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:53.877216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1244/2479] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:05:53 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:05:53.878469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.889492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d4d33-f0e6-4e32-8128-20c5124673f1 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.894656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.895349 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.895634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.896006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.896747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.898426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:53.909494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1236/2480] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:53.913925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.925099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d239d-2b51-430c-b8b9-77f10cf6bde3 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.931204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd675bc-1a47-4fd4-8bf7-711d4a87ba59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.932560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd675bc-1a47-4fd4-8bf7-711d4a87ba59 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.932765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd675bc-1a47-4fd4-8bf7-711d4a87ba59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.933069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd675bc-1a47-4fd4-8bf7-711d4a87ba59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.933955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd675bc-1a47-4fd4-8bf7-711d4a87ba59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.935859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd675bc-1a47-4fd4-8bf7-711d4a87ba59 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:53.937762 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:53.952736 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1245/2481] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:53.954356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:53.964396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf6c1-ac44-4c97-b13c-a96d11937700 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:53.969011 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:53.969884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:53.970168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:53.970442 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] PATH_INFO: `/v3/projects/fb091e43165f445b80b5599437042061/users/7569b9b26a79486bb55aff585be0b986/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:53.983641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:53.987804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb091e43165f445b80b5599437042061, user_id=7569b9b26a79486bb55aff585be0b986, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:53.992108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.020773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1237/2482] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:53 2022] PUT /identity/v3/projects/fb091e43165f445b80b5599437042061/users/7569b9b26a79486bb55aff585be0b986/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:54.023578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.023872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.024208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.054898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] MFA Rules not processed for user `7569b9b26a79486bb55aff585be0b986`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:54.056203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:54.139161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1246/2483] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:05:54.140036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.214219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8522ca1-d831-40e2-96bb-ee1b66c4f42a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.219942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.220651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.220934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.221833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.222065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.224180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.255202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1238/2484] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:05:54 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:05:54.256675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.268099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdde1fc-b614-4805-8da3-547b5df62316 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.329881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.330562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.330844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.331184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.332032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.334315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.363305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1247/2485] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:05:54 2022] POST /identity/v3/users => generated 307 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:05:54.367397 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.380484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd138-4d5f-4d6a-8d73-cee863a271de admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.386551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.387254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.387537 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.387855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.388630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.390230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.403334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1239/2486] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:54.407636 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.418029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9cf73-3375-4137-be38-9e7859193301 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.422828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.423776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.424200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.424485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] PATH_INFO: `/v3/projects/64927748fcc54d25bb295a7aace6697d/users/38fd829867104513b094fda3220626c8/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.458691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64927748fcc54d25bb295a7aace6697d, user_id=38fd829867104513b094fda3220626c8, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.462325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.489612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1248/2487] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:54 2022] PUT /identity/v3/projects/64927748fcc54d25bb295a7aace6697d/users/38fd829867104513b094fda3220626c8/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:54.490834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.503512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fe850-3f71-4301-955d-f22af8a01948 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.595640 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8044a-d2cf-4657-87e0-d2517a642ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.596211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8044a-d2cf-4657-87e0-d2517a642ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.596500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8044a-d2cf-4657-87e0-d2517a642ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.596781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8044a-d2cf-4657-87e0-d2517a642ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.597639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8044a-d2cf-4657-87e0-d2517a642ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.599273 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8044a-d2cf-4657-87e0-d2517a642ac9 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.615745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1240/2488] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:05:54.620215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.631526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9d4c-54c7-4652-849a-02a40333343e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.637410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.638560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.638836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.639108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] PATH_INFO: `/v3/projects/64927748fcc54d25bb295a7aace6697d/users/38fd829867104513b094fda3220626c8/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.641501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64927748fcc54d25bb295a7aace6697d, user_id=38fd829867104513b094fda3220626c8, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.644204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.657250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1249/2489] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:05:54 2022] PUT /identity/v3/projects/64927748fcc54d25bb295a7aace6697d/users/38fd829867104513b094fda3220626c8/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:54.667416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.667965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.668387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.704963 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] MFA Rules not processed for user `38fd829867104513b094fda3220626c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:54.706259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:54.755580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:54.785006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1241/2490] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:54.796213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.797900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:54.843086 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:54.860153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7a889-f17a-4d8a-a36d-fb738d21e2c1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.863999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.864655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.864935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.865208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:54.875887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:54.877422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:54.887182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1250/2491] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:05:54.960712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:54.970087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1a0a4-763e-46c5-a959-9a414bee9944 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:54.973751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:54.974387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:54.974668 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:54.974973 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:55.032431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:55.033909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:55.043482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1242/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:58.187620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:58.189055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:58.251178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9858d6-d4af-4fb9-98ae-2cc9ea459eee service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:58.254738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:58.255374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:58.255658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:58.255933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:58.257824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:58.319116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:58.320637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9401-ccdd-4136-904a-0e76db6582ed service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:58.330165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1251/2493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:59.044152 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:59.055199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8f22a-79d7-49dc-b892-332274a84ac6 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:59.060075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:59.061131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:59.061472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:59.061635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] PATH_INFO: `/v3/users/7569b9b26a79486bb55aff585be0b986` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:59.062837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7569b9b26a79486bb55aff585be0b986)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:59.064795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:59.122132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7569b9b26a79486bb55aff585be0b986'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.133926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7569b9b26a79486bb55aff585be0b986'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.134600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7569b9b26a79486bb55aff585be0b986'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.141554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7569b9b26a79486bb55aff585be0b986'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.148808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7569b9b26a79486bb55aff585be0b986'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.155069 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1243/2494] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:59 2022] DELETE /identity/v3/users/7569b9b26a79486bb55aff585be0b986 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:59.159771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:59.160181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:59.160534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:59.178305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:05:59.180180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:59.240707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1252/2495] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:05:59.251146 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:59.253036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:59.318803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92c35-2097-453f-8836-80314d65f9fa admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:59.322639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:59.323377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:59.324102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:59.324102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:59.335521 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:59.337179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:59.343294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:59.367734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1244/2496] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:05:59.659348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:59.661469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:05:59.674866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca1c30-32b4-4d5b-a671-c9909099b92c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:59.680072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:59.681015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:59.681365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:59.681714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] PATH_INFO: `/v3/projects/fb091e43165f445b80b5599437042061` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:59.682973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb091e43165f445b80b5599437042061)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:59.685130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:59.719570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:05:59.742629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb091e43165f445b80b5599437042061', 'request_id': 'req-6dcd0892-cb2b-4ad8-af70-6b82566267f7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.749233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb091e43165f445b80b5599437042061', 'request_id': 'req-6dcd0892-cb2b-4ad8-af70-6b82566267f7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.758674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb091e43165f445b80b5599437042061', 'request_id': 'req-6dcd0892-cb2b-4ad8-af70-6b82566267f7'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.770211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] The token cache is being invalidate because project fb091e43165f445b80b5599437042061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:05:59.770591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.771355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.776380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1253/2497] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:05:59 2022] DELETE /identity/v3/projects/fb091e43165f445b80b5599437042061 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:05:59.777486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:05:59.787675 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef41566-8c98-40ea-9b1f-33309fbc501f service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:05:59.867017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:05:59.867907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:05:59.868220 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:05:59.868494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] PATH_INFO: `/v3/users/38fd829867104513b094fda3220626c8` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:05:59.869865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fd829867104513b094fda3220626c8)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:05:59.871830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:05:59.934064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fd829867104513b094fda3220626c8'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.950064 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fd829867104513b094fda3220626c8'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.950860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fd829867104513b094fda3220626c8'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.957826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fd829867104513b094fda3220626c8'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.972382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-5a1a2797-2324-472a-af2d-000b90661980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fd829867104513b094fda3220626c8'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:05:59.979421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1245/2498] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:05:59 2022] DELETE /identity/v3/users/38fd829867104513b094fda3220626c8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:00.272892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.275402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:00.309820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd0892-cb2b-4ad8-af70-6b82566267f7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.386984 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.389640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.390156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.390703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] PATH_INFO: `/v3/projects/64927748fcc54d25bb295a7aace6697d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.392787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64927748fcc54d25bb295a7aace6697d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.395928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:00.455120 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64927748fcc54d25bb295a7aace6697d', 'request_id': 'req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:00.465537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64927748fcc54d25bb295a7aace6697d', 'request_id': 'req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:00.474331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64927748fcc54d25bb295a7aace6697d', 'request_id': 'req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:00.487026 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] The token cache is being invalidate because project 64927748fcc54d25bb295a7aace6697d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:00.487362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:00.488072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9b1f92fa-a118-45f6-a2f7-00b5f053ef93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:00.492052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1254/2499] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:00 2022] DELETE /identity/v3/projects/64927748fcc54d25bb295a7aace6697d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:00.495210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.495733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.495823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.517265 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:00.518807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:00.584544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1246/2500] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:00.593887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.594180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.594464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.613170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:00.614393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:00.622858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1255/2501] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:00.627239 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.637523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e34505-3dfd-4d98-bfac-03dfea511fb7 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.642223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.642881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.643169 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.643447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.644212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:00.644526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.646129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:00.659010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1247/2502] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:00.663201 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.672839 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284de42d-f3df-4d3b-b549-9381e3a24b8d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.678042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.679027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.679321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.679606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.680343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.682260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:00.710848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1256/2503] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:00 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:00.714970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.731584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bffdf-2f9f-494b-a12f-e674327c7e9e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.737612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:00.822362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.823691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.823691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.823691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.824288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.826367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:00.853608 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1248/2504] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:00 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:00.854927 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.867394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b46dc2-ef51-4854-a1d7-5c648312c038 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.871956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.872652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.872948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.873221 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.873950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.875552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:00.901279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1257/2505] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:00.904903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.914997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cd19e-a866-4a29-972f-531e355dad90 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.919541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531fa90-de1f-4804-89e1-5518944d340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.920226 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531fa90-de1f-4804-89e1-5518944d340c admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.920517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531fa90-de1f-4804-89e1-5518944d340c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.920788 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531fa90-de1f-4804-89e1-5518944d340c admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.921538 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531fa90-de1f-4804-89e1-5518944d340c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.923138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531fa90-de1f-4804-89e1-5518944d340c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:00.939765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1249/2506] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:00.946974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:00.952790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:00.957386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e829da0-3aa2-456a-bbd5-8b8c04cf15b2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:00.964708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:00.966900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:00.967459 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:00.968427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] PATH_INFO: `/v3/projects/311e780fc6ed4981a38701114fc510fc/users/cbf135ff8f2842cb9764dd891dd54eca/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:00.984215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=311e780fc6ed4981a38701114fc510fc, user_id=cbf135ff8f2842cb9764dd891dd54eca, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:00.987194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.004712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1258/2507] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:00 2022] PUT /identity/v3/projects/311e780fc6ed4981a38701114fc510fc/users/cbf135ff8f2842cb9764dd891dd54eca/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:01.012705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.013000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.013281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.040802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] MFA Rules not processed for user `cbf135ff8f2842cb9764dd891dd54eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:01.041978 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:01.114470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1250/2508] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:01.117346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.220783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4e81e-2614-46cc-8e32-81562199b81e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.227546 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.228447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.228733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.229012 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.229705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.231683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.278699 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1259/2509] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:01 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:01.282557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.295180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740b0b1-d964-4a2c-b82c-3487ccefea36 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.364255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.364943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.365227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.365512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.366924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.368513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.393202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1251/2510] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:01 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:01.396051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.407504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadb1ee-22df-400f-b24f-6304e8abc808 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.413287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.414077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.414430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.414782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.415616 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.417377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.430052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1260/2511] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:01.434350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.443485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:01.447171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd7400-a16a-47db-bdeb-7592a9ea17ca admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.454260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.455650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.456074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.456818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] PATH_INFO: `/v3/projects/f16b4ca1efc541f095ca88419cdca430/users/c63d2cdc8a94427eb638ed52f6e28bea/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.475601 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16b4ca1efc541f095ca88419cdca430, user_id=c63d2cdc8a94427eb638ed52f6e28bea, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.478493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.495422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1252/2512] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:01 2022] PUT /identity/v3/projects/f16b4ca1efc541f095ca88419cdca430/users/c63d2cdc8a94427eb638ed52f6e28bea/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:01.499615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.511074 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf4d8a-9aaf-437b-b887-3755d091dda9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.605406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0f93a-2514-4938-b9f3-b8c147a3a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.606628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f93a-2514-4938-b9f3-b8c147a3a4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.607167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f93a-2514-4938-b9f3-b8c147a3a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.607806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0f93a-2514-4938-b9f3-b8c147a3a4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.610232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f93a-2514-4938-b9f3-b8c147a3a4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.613643 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0f93a-2514-4938-b9f3-b8c147a3a4e8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.633079 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1261/2513] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:01.634742 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.653852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c7a7-2a8c-4ed8-b036-1dce8083c178 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.659319 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.660590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.661256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.661390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] PATH_INFO: `/v3/projects/f16b4ca1efc541f095ca88419cdca430/users/c63d2cdc8a94427eb638ed52f6e28bea/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.663579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16b4ca1efc541f095ca88419cdca430, user_id=c63d2cdc8a94427eb638ed52f6e28bea, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.666512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.680705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1253/2514] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:01 2022] PUT /identity/v3/projects/f16b4ca1efc541f095ca88419cdca430/users/c63d2cdc8a94427eb638ed52f6e28bea/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:01.692540 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.693064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.693444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.722953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] MFA Rules not processed for user `c63d2cdc8a94427eb638ed52f6e28bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:01.724398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:01.773897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:01.812692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1262/2515] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:01.827399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:01.829482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:01.911494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681e6a-5972-4469-b9e2-4957356fbb01 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:01.916149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:01.916870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:01.917157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:01.917438 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:01.927560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:01.929795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:01.953495 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1254/2516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:02.064938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:02.078259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf48f7-72e2-4b9b-9969-554e2205865f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:02.082650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:02.083278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.083584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.083864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.165741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:02.167334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:02.182184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1263/2517] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:02.204327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:02.206659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:02.278153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647eb41-a8f5-4fdd-8cd2-e055874a7ab8 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:02.283754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:02.284679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.285076 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.285247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] PATH_INFO: `/v3/users/d3d76c556b5f41f19c1a2a466a031cdf` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.286445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d76c556b5f41f19c1a2a466a031cdf)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:02.288440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:02.343098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d76c556b5f41f19c1a2a466a031cdf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.356172 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d76c556b5f41f19c1a2a466a031cdf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.356902 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d76c556b5f41f19c1a2a466a031cdf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.363219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:02.365784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d76c556b5f41f19c1a2a466a031cdf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.374217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f951a362-beb2-498c-b182-784d73ac9646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d76c556b5f41f19c1a2a466a031cdf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.381498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1255/2518] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:02 2022] DELETE /identity/v3/users/d3d76c556b5f41f19c1a2a466a031cdf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:02.577157 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:02.588355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23f05-f7d7-42d4-8697-69b7b260cff8 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:02.645879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:02.646739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.647020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.647296 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] PATH_INFO: `/v3/projects/1a5852acb729432e89c68955c8ed5e8b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.648533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5852acb729432e89c68955c8ed5e8b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:02.650430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:02.696908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5852acb729432e89c68955c8ed5e8b', 'request_id': 'req-7c762fb6-5cf8-43fa-976f-63b8356bcd47'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.702765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5852acb729432e89c68955c8ed5e8b', 'request_id': 'req-7c762fb6-5cf8-43fa-976f-63b8356bcd47'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.709612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5852acb729432e89c68955c8ed5e8b', 'request_id': 'req-7c762fb6-5cf8-43fa-976f-63b8356bcd47'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.719587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] The token cache is being invalidate because project 1a5852acb729432e89c68955c8ed5e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:02.719869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.720510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-7c762fb6-5cf8-43fa-976f-63b8356bcd47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:02.722034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1264/2519] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:02 2022] DELETE /identity/v3/projects/1a5852acb729432e89c68955c8ed5e8b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:02.727611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722989-6651-4d43-86c0-c54efc806aad None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.728102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722989-6651-4d43-86c0-c54efc806aad None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.728308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88722989-6651-4d43-86c0-c54efc806aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.746795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-88722989-6651-4d43-86c0-c54efc806aad None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:02.747915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-88722989-6651-4d43-86c0-c54efc806aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:02.806068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1256/2520] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:02.814242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.814560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.814842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.822451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:02.834070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:02.835548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:02.843356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1265/2521] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:02.847509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722989-6651-4d43-86c0-c54efc806aad None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:02.857583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88722989-6651-4d43-86c0-c54efc806aad None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:02.862457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:02.863079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.863344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.863616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.864363 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:02.864666 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:02.866943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:02.878421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1257/2522] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:02.882628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:02.891999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926aba1-7d0c-4264-b69c-7e24e44a7af9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:02.896985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:02.897635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.897922 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.898202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.898929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:02.901279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:02.928356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1266/2523] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:02 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:02.931857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:02.941856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c22dc-3606-47a4-87e4-65156532489d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:02.996387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:02.997129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:02.997353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:02.997626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:02.998311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.000223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.020440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1258/2524] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:02 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:03.024832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.035393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a769-930f-425a-92dc-37ce2c87480d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.040872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.041547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.041864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.042147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.042876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.044520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.055260 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1267/2525] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:03.059261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.069303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbc1c5-7407-4439-9435-7e7cbe1f4729 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.074081 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfec209-36a9-43fb-a894-0b4eb084a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.074758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfec209-36a9-43fb-a894-0b4eb084a552 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.075033 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfec209-36a9-43fb-a894-0b4eb084a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.075335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfec209-36a9-43fb-a894-0b4eb084a552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.076096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfec209-36a9-43fb-a894-0b4eb084a552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.077688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfec209-36a9-43fb-a894-0b4eb084a552 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.089102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1259/2526] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:03.093482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.105766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d8d04-55ee-44aa-8620-bd9325868b41 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.110587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.111561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.111905 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.112282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] PATH_INFO: `/v3/projects/3f3cd19473fe43218be0bd6a0e0f62cb/users/6c05f60b698343d483a6e91c152965d4/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.127117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3cd19473fe43218be0bd6a0e0f62cb, user_id=6c05f60b698343d483a6e91c152965d4, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.129781 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.143738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1268/2527] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:03 2022] PUT /identity/v3/projects/3f3cd19473fe43218be0bd6a0e0f62cb/users/6c05f60b698343d483a6e91c152965d4/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:03.154387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.154699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.154980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.181932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] MFA Rules not processed for user `6c05f60b698343d483a6e91c152965d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:03.183142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:03.232501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:03.250464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1260/2528] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:03.254870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.317325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f0a9-b1a3-4133-a585-d57cde6e4144 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.322768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.323432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.323717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.324022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.324724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.326645 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.355739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1269/2529] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:03 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:03.357063 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.368741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520fee1-c979-40da-b2d5-3e85cbcf05b0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.424635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.425295 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.425577 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.425854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.426532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.428466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.449514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1261/2530] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:03 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:03.453472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.463637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3155f84-203e-472f-9f71-90fc56f84b3c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.468682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.469346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.469630 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.469908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.470640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.472305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.483926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1270/2531] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:03.487193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.497876 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4038a02-8926-4487-aa48-902877ef9a7e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.502764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.503636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.503923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.504231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] PATH_INFO: `/v3/projects/7d9fda6e35234a148796f69757a2f70e/users/de55d08298d4487cba9fb1f18b06199e/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.519167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9fda6e35234a148796f69757a2f70e, user_id=de55d08298d4487cba9fb1f18b06199e, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.521914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.535243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1262/2532] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:03 2022] PUT /identity/v3/projects/7d9fda6e35234a148796f69757a2f70e/users/de55d08298d4487cba9fb1f18b06199e/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:03.539744 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.549846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1475-1777-479f-ad4e-8cc6d49d4302 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.606509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef1d4b-2dc2-43b3-be48-3aa5536af2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.607404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef1d4b-2dc2-43b3-be48-3aa5536af2de admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.607686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef1d4b-2dc2-43b3-be48-3aa5536af2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.607959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef1d4b-2dc2-43b3-be48-3aa5536af2de admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.608707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef1d4b-2dc2-43b3-be48-3aa5536af2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.610310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ef1d4b-2dc2-43b3-be48-3aa5536af2de admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.623689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1271/2533] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:03.625260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.637341 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ac71e-e7d1-4284-b1bc-f91b635648aa admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.642270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.643150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.643428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.643700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] PATH_INFO: `/v3/projects/7d9fda6e35234a148796f69757a2f70e/users/de55d08298d4487cba9fb1f18b06199e/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.645716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9fda6e35234a148796f69757a2f70e, user_id=de55d08298d4487cba9fb1f18b06199e, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.648402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.659654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1263/2534] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:03 2022] PUT /identity/v3/projects/7d9fda6e35234a148796f69757a2f70e/users/de55d08298d4487cba9fb1f18b06199e/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:03.671443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.671809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.672123 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.691457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:03.701836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] MFA Rules not processed for user `de55d08298d4487cba9fb1f18b06199e`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:03.703514 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:03.778272 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1272/2535] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:03.790108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.791845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:03.847229 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447638-971a-48bb-b116-e7d60a53aa94 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.851883 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.852576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.852858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.853135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:03.862412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:03.863849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:03.874344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1264/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:03.946926 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:03.957303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ec3c8-f2ca-48ad-94cd-5466729a6c35 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:03.962520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1d705-a0ec-47cb-ba97-e61be71644f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:03.963174 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1d705-a0ec-47cb-ba97-e61be71644f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:03.963458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1d705-a0ec-47cb-ba97-e61be71644f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:03.963738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1d705-a0ec-47cb-ba97-e61be71644f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:04.027676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1d705-a0ec-47cb-ba97-e61be71644f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:04.029155 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1d705-a0ec-47cb-ba97-e61be71644f6 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:04.040160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1273/2537] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:04.789736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:04.791139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:04.836347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:04.858619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78047a9-a9d1-4dba-9316-846843976756 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:04.863270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:04.864162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:04.864444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:04.864719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] PATH_INFO: `/v3/users/cbf135ff8f2842cb9764dd891dd54eca` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:04.865891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbf135ff8f2842cb9764dd891dd54eca)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:04.868600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:04.913972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbf135ff8f2842cb9764dd891dd54eca'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:04.925377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbf135ff8f2842cb9764dd891dd54eca'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:04.926025 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbf135ff8f2842cb9764dd891dd54eca'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:04.934121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbf135ff8f2842cb9764dd891dd54eca'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:04.941871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbf135ff8f2842cb9764dd891dd54eca'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:04.947924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1265/2538] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:04 2022] DELETE /identity/v3/users/cbf135ff8f2842cb9764dd891dd54eca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:04.952413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:04.952910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:04.953024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:04.970184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:04.971368 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:05.028688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1274/2539] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:05.038684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:05.040083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:05.096684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14239f-6da6-4071-9c48-e0e6537b8254 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:05.100949 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:05.101714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:05.101873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:05.102149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:05.111283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:05.112759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:05.122839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1266/2540] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:05.392557 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:05.394496 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:05.408129 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc50d1-192d-4e92-a069-87025069193c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:05.413747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:05.414569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:05.414910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:05.415126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] PATH_INFO: `/v3/projects/311e780fc6ed4981a38701114fc510fc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:05.416366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=311e780fc6ed4981a38701114fc510fc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:05.418284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:05.454515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:05.468434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '311e780fc6ed4981a38701114fc510fc', 'request_id': 'req-c09b41fc-826e-4fae-a84b-641bf05633a8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.474873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '311e780fc6ed4981a38701114fc510fc', 'request_id': 'req-c09b41fc-826e-4fae-a84b-641bf05633a8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.483516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '311e780fc6ed4981a38701114fc510fc', 'request_id': 'req-c09b41fc-826e-4fae-a84b-641bf05633a8'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.508626 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] The token cache is being invalidate because project 311e780fc6ed4981a38701114fc510fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:05.508921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.509664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.514025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1275/2541] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:05 2022] DELETE /identity/v3/projects/311e780fc6ed4981a38701114fc510fc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:05.515937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:05.528636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82232c11-85b3-406a-a0ce-6de7184dd9f5 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:05.614080 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:05.615170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:05.615448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:05.615722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] PATH_INFO: `/v3/users/c63d2cdc8a94427eb638ed52f6e28bea` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:05.617209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63d2cdc8a94427eb638ed52f6e28bea)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:05.619107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:05.621520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:05.669755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63d2cdc8a94427eb638ed52f6e28bea'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.682422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63d2cdc8a94427eb638ed52f6e28bea'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.683175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63d2cdc8a94427eb638ed52f6e28bea'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.690437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63d2cdc8a94427eb638ed52f6e28bea'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.698513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-882b1cd3-b620-42a7-8d33-184537e3ec5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63d2cdc8a94427eb638ed52f6e28bea'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:05.705701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1267/2542] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:05 2022] DELETE /identity/v3/users/c63d2cdc8a94427eb638ed52f6e28bea => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:05.983512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:05.986069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:06.002501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b41fc-826e-4fae-a84b-641bf05633a8 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.064921 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.065920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.066387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.066755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] PATH_INFO: `/v3/projects/f16b4ca1efc541f095ca88419cdca430` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.068131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16b4ca1efc541f095ca88419cdca430)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.070908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.126640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16b4ca1efc541f095ca88419cdca430', 'request_id': 'req-32ebd313-b468-4e26-9789-47747d038f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:06.133458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16b4ca1efc541f095ca88419cdca430', 'request_id': 'req-32ebd313-b468-4e26-9789-47747d038f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:06.141444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16b4ca1efc541f095ca88419cdca430', 'request_id': 'req-32ebd313-b468-4e26-9789-47747d038f14'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:06.151857 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] The token cache is being invalidate because project f16b4ca1efc541f095ca88419cdca430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:06.152170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:06.152792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-32ebd313-b468-4e26-9789-47747d038f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:06.154328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1276/2543] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:05 2022] DELETE /identity/v3/projects/f16b4ca1efc541f095ca88419cdca430 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:06.159591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.160090 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.160203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.179212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:06.180565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:06.242115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1268/2544] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:06.252973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.253441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.253718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.274973 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:06.276241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:06.284868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1277/2545] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:06.289130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.298875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7fba1-9187-40b6-853b-b762a60310de None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.304078 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.304891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.305185 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.305465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.306197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:06.306508 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.308140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.320810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1269/2546] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:06.325055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.334350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979395-1a01-4b1d-baaa-45316f1a98e7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.339228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.339872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.340189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.340465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.341162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.343043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.369812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1278/2547] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:06.373982 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.384618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0943921-6421-4a0a-ae9f-f0f8a4021181 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.439761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.440453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.440765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.441049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.441729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.443651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.458111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:06.465088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1270/2548] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:06.469199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.480084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df9da4-52dd-4bee-8f0b-b00c245ce138 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.484583 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.485229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.485508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.485784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.486526 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.488148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.498896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1279/2549] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:06.502662 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.512693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2b8d4-6aeb-40b2-9b7a-26d94e5fe5d4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.517338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba0906-9117-40a5-b50b-978bf226c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.517985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0906-9117-40a5-b50b-978bf226c3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.518271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0906-9117-40a5-b50b-978bf226c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.518551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba0906-9117-40a5-b50b-978bf226c3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.519274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba0906-9117-40a5-b50b-978bf226c3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.520900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba0906-9117-40a5-b50b-978bf226c3cd admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.532747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1271/2550] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:06.536941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.547482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7914a-c712-4e72-87ef-cc515953e40a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.552247 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.553134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.553419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.554320 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] PATH_INFO: `/v3/projects/395141751cc9421d97443d2029970866/users/30c42917bfba4bbfbe6bf9ccb8f50303/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.557349 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:06.570827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=395141751cc9421d97443d2029970866, user_id=30c42917bfba4bbfbe6bf9ccb8f50303, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.573504 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.586099 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1280/2551] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:06 2022] PUT /identity/v3/projects/395141751cc9421d97443d2029970866/users/30c42917bfba4bbfbe6bf9ccb8f50303/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:06.596253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.596722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.597053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.624628 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] MFA Rules not processed for user `30c42917bfba4bbfbe6bf9ccb8f50303`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:06.625869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:06.692764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1272/2552] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:06.696961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.762275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd7029-f7da-41cc-a331-16a71877b06d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.770188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.770954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.771321 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.771855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.773183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.775233 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.803114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1281/2553] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:06.807863 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.819336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18153324-a256-45a9-9276-038ca5ffa136 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.889286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.890079 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.890463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.890855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.891673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.893836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.915197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1273/2554] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:06 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:06.919282 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.929606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4ecfb-3d43-4492-82aa-44a01cc22ce2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.934547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.935209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.935489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.935763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.936522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.938228 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:06.950223 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1282/2555] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:06.954499 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:06.965017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db089dd-aaad-4522-86bf-2d1676a00634 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:06.969820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:06.970699 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:06.970985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:06.971266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] PATH_INFO: `/v3/projects/a13c16a3476f42d6876a76e985600048/users/f91a0616a4a3422d84b654833ee044ba/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:06.986382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13c16a3476f42d6876a76e985600048, user_id=f91a0616a4a3422d84b654833ee044ba, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:06.989072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:07.002312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1274/2556] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:06 2022] PUT /identity/v3/projects/a13c16a3476f42d6876a76e985600048/users/f91a0616a4a3422d84b654833ee044ba/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:07.006258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:07.017276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed831fa-25d5-4e64-a747-c41d1ad4febc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:07.072746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2bd14-fa0f-4a7b-a013-073d2e1e4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:07.073414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bd14-fa0f-4a7b-a013-073d2e1e4edf admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.073735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bd14-fa0f-4a7b-a013-073d2e1e4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.074071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2bd14-fa0f-4a7b-a013-073d2e1e4edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.074800 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2bd14-fa0f-4a7b-a013-073d2e1e4edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:07.076432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2bd14-fa0f-4a7b-a013-073d2e1e4edf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:07.086816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1283/2557] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:07.091116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:07.102091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c9f5-37c1-4342-a871-ab28c96bc6a4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:07.106759 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:07.107644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.107953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.108262 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] PATH_INFO: `/v3/projects/a13c16a3476f42d6876a76e985600048/users/f91a0616a4a3422d84b654833ee044ba/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.110247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13c16a3476f42d6876a76e985600048, user_id=f91a0616a4a3422d84b654833ee044ba, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:07.112976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:07.123354 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1275/2558] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:07 2022] PUT /identity/v3/projects/a13c16a3476f42d6876a76e985600048/users/f91a0616a4a3422d84b654833ee044ba/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:07.134848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.135219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.135510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.164448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] MFA Rules not processed for user `f91a0616a4a3422d84b654833ee044ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:07.165700 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:07.209715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:07.235255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1284/2559] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:07.247344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:07.249086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:07.281371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:07.307103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ca4b3-97a0-4b0f-82f5-056e60f05b28 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:07.310781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:07.311412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.311693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.311989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.321415 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:07.322919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:07.332259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1276/2560] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:07.400087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:07.409911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff1b57-7e47-4010-bdca-e69d1ee52ca8 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:07.413494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e452f86-d8a8-4ba3-8d43-4dce91a36c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:07.414134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452f86-d8a8-4ba3-8d43-4dce91a36c0d service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.414416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452f86-d8a8-4ba3-8d43-4dce91a36c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.414693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e452f86-d8a8-4ba3-8d43-4dce91a36c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.469667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e452f86-d8a8-4ba3-8d43-4dce91a36c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:07.471333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e452f86-d8a8-4ba3-8d43-4dce91a36c0d service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:07.480787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1285/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:07.736100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:07.796582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950e64-ed23-4f7c-93aa-03125b63a7e7 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:07.801087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:07.801944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.802230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.802510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] PATH_INFO: `/v3/users/30c42917bfba4bbfbe6bf9ccb8f50303` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.804246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c42917bfba4bbfbe6bf9ccb8f50303)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:07.806162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:07.849871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c42917bfba4bbfbe6bf9ccb8f50303'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:07.862253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c42917bfba4bbfbe6bf9ccb8f50303'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:07.862944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c42917bfba4bbfbe6bf9ccb8f50303'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:07.870956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c42917bfba4bbfbe6bf9ccb8f50303'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:07.877624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c42917bfba4bbfbe6bf9ccb8f50303'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:07.884378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1277/2562] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:07 2022] DELETE /identity/v3/users/30c42917bfba4bbfbe6bf9ccb8f50303 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:07.888745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:07.889032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:07.889307 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:07.905829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:07.907006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:07.966962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1286/2563] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:07.978060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:07.979613 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:08.040187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a5d2c-88b2-4470-8e18-9d412f8ab85d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:08.043822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:08.044490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:08.044769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:08.045038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:08.051121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:08.056507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:08.058380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:08.069300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1278/2564] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:08.343612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:08.345104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:08.359529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d4717-59fd-4f30-8eb6-3b2ecd3fa12b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:08.365346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:08.366203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:08.366748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:08.367138 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] PATH_INFO: `/v3/projects/395141751cc9421d97443d2029970866` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:08.368290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] RBAC: Authorizing `identity:delete_project(project_id=395141751cc9421d97443d2029970866)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:08.370347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:08.416995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395141751cc9421d97443d2029970866', 'request_id': 'req-4c676b0b-eefe-4f0f-8688-f17fdd79231b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.422891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395141751cc9421d97443d2029970866', 'request_id': 'req-4c676b0b-eefe-4f0f-8688-f17fdd79231b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.430191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395141751cc9421d97443d2029970866', 'request_id': 'req-4c676b0b-eefe-4f0f-8688-f17fdd79231b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.440217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] The token cache is being invalidate because project 395141751cc9421d97443d2029970866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:08.440495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.441115 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.442627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1287/2565] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:08 2022] DELETE /identity/v3/projects/395141751cc9421d97443d2029970866 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:08.446707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:08.456209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033638-4d65-46bc-b72f-442c2529f32d service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:08.511072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:08.511926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:08.512258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:08.512533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] PATH_INFO: `/v3/users/f91a0616a4a3422d84b654833ee044ba` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:08.513710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91a0616a4a3422d84b654833ee044ba)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:08.515614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:08.560600 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91a0616a4a3422d84b654833ee044ba'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.572125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91a0616a4a3422d84b654833ee044ba'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.572789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91a0616a4a3422d84b654833ee044ba'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.579518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91a0616a4a3422d84b654833ee044ba'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.587128 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-0f403c83-bd78-4859-8709-9cfed864250e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91a0616a4a3422d84b654833ee044ba'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.593095 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1279/2566] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:08 2022] DELETE /identity/v3/users/f91a0616a4a3422d84b654833ee044ba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:08.861034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:08.862489 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:08.871166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:08.877619 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c676b0b-eefe-4f0f-8688-f17fdd79231b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:08.941025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:08.941891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:08.942176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:08.942480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] PATH_INFO: `/v3/projects/a13c16a3476f42d6876a76e985600048` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:08.943660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13c16a3476f42d6876a76e985600048)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:08.946148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:08.991151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13c16a3476f42d6876a76e985600048', 'request_id': 'req-570849d2-5fd5-44bf-b608-8d4bf5e962ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:08.997454 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13c16a3476f42d6876a76e985600048', 'request_id': 'req-570849d2-5fd5-44bf-b608-8d4bf5e962ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.004851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13c16a3476f42d6876a76e985600048', 'request_id': 'req-570849d2-5fd5-44bf-b608-8d4bf5e962ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.015895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] The token cache is being invalidate because project a13c16a3476f42d6876a76e985600048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:09.016215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.016850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-570849d2-5fd5-44bf-b608-8d4bf5e962ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.018373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1288/2567] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:08 2022] DELETE /identity/v3/projects/a13c16a3476f42d6876a76e985600048 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:09.023651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.023938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.024263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.041966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:09.043147 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:09.101959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1280/2568] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:09.109796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.110084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.110362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.129261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:09.130384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:09.139128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1289/2569] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:09.143379 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.153034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c1180-b04e-4022-bd4a-8d2d4fddbfe0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.157611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.158259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.158591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.158868 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.159589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:09.159893 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.161552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.169964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:09.177140 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1281/2570] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:06:09.179518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.190380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f8049-8e2c-4e6f-be95-346ee88f51a7 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.195901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.196605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.196890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.197170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.197868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.199777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.230463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1290/2571] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:09 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:09.231718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.242739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1983fe-cde9-4ab6-a66e-433123d2ff8a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.299414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.300104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.300387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.300659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.301332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.303232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.323398 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1282/2572] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:09 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:09.327406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.337472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eec415-b7c1-4d77-aa97-2465fd64b285 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.342016 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.342667 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.342948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.343225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.343941 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.345541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.355647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1291/2573] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:09.359356 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.369947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caafc95d-d99f-435f-8307-60c483d720a6 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.374592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab06d04-a949-4316-a36f-a83ddea3e71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.375266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab06d04-a949-4316-a36f-a83ddea3e71d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.375552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab06d04-a949-4316-a36f-a83ddea3e71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.375828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab06d04-a949-4316-a36f-a83ddea3e71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.376595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab06d04-a949-4316-a36f-a83ddea3e71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.378199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab06d04-a949-4316-a36f-a83ddea3e71d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.388881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1283/2574] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:09.392687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.402649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab8ad-fa1c-40bf-bbfd-ae6c8edc1a80 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.407291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.408191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.408473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.408743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] PATH_INFO: `/v3/projects/92e1e76afd34410dbcf701cce30dd70d/users/900f82723c5b4f3e82c4b05e4a7b7e1d/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.423151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e1e76afd34410dbcf701cce30dd70d, user_id=900f82723c5b4f3e82c4b05e4a7b7e1d, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.425803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.438850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1292/2575] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:09 2022] PUT /identity/v3/projects/92e1e76afd34410dbcf701cce30dd70d/users/900f82723c5b4f3e82c4b05e4a7b7e1d/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:09.449127 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.449617 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.449736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.475309 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] MFA Rules not processed for user `900f82723c5b4f3e82c4b05e4a7b7e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:09.477030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:09.539578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1284/2576] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:09.550472 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.552203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:09.583398 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:09.610262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e3917-f194-451a-b722-13af61492412 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.614128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a245e14-4c22-4bbf-921a-73d5984fbefc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.614768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e14-4c22-4bbf-921a-73d5984fbefc service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.615053 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e14-4c22-4bbf-921a-73d5984fbefc service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.615333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a245e14-4c22-4bbf-921a-73d5984fbefc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.624639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245e14-4c22-4bbf-921a-73d5984fbefc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.626066 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a245e14-4c22-4bbf-921a-73d5984fbefc service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.634869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1293/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:09.653490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.715631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c304-2337-4d68-a1fc-138a81aef87d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.720219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.721088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.721371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.721647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] PATH_INFO: `/v3/users/900f82723c5b4f3e82c4b05e4a7b7e1d` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.722831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900f82723c5b4f3e82c4b05e4a7b7e1d)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.724785 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:09.735629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:09.770190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900f82723c5b4f3e82c4b05e4a7b7e1d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.782502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900f82723c5b4f3e82c4b05e4a7b7e1d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.783182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900f82723c5b4f3e82c4b05e4a7b7e1d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.790517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900f82723c5b4f3e82c4b05e4a7b7e1d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.797485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900f82723c5b4f3e82c4b05e4a7b7e1d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:09.803383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1285/2578] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:09 2022] DELETE /identity/v3/users/900f82723c5b4f3e82c4b05e4a7b7e1d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:09.808143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.808438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.808720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.825217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:09.826411 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:09.885294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1294/2579] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:09.895058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:09.896456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:09.973595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdf398-aaa0-4a35-8f71-827b0c3a27a8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:09.978036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a03d85-752f-43a0-9357-1db1dd202501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:09.978827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03d85-752f-43a0-9357-1db1dd202501 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:09.979132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03d85-752f-43a0-9357-1db1dd202501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:09.979431 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a03d85-752f-43a0-9357-1db1dd202501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:09.989236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a03d85-752f-43a0-9357-1db1dd202501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:09.990979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a03d85-752f-43a0-9357-1db1dd202501 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.001210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1286/2580] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:10.284220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.285641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:10.298577 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a200d-99ef-48ea-afc6-c5efe4bb5a2c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.303579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.304711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.304953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.305237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] PATH_INFO: `/v3/projects/92e1e76afd34410dbcf701cce30dd70d` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.306465 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e1e76afd34410dbcf701cce30dd70d)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.308512 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.375669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e1e76afd34410dbcf701cce30dd70d', 'request_id': 'req-9cba989a-fabf-43d1-acf4-009686577d71'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:10.383088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e1e76afd34410dbcf701cce30dd70d', 'request_id': 'req-9cba989a-fabf-43d1-acf4-009686577d71'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:10.392428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e1e76afd34410dbcf701cce30dd70d', 'request_id': 'req-9cba989a-fabf-43d1-acf4-009686577d71'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:10.405548 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] The token cache is being invalidate because project 92e1e76afd34410dbcf701cce30dd70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:10.405705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:10.406404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-9cba989a-fabf-43d1-acf4-009686577d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:10.408463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1295/2581] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:10 2022] DELETE /identity/v3/projects/92e1e76afd34410dbcf701cce30dd70d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:10.413572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.414193 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.414552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.436493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:10.437897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:10.518372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1287/2582] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:10.527915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.528367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.528657 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.547367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:10.548622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:10.558268 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1296/2583] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:10.562266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.573327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b7e0f-3011-480b-9b11-ffd1e1e14830 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.578913 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.579593 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.579896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.580247 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.581016 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:10.581325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.582961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.595735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1288/2584] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:10.600407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.609584 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae72ac-e02a-4230-98ef-2ad716e7b6cf None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.614290 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.614939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.615226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.615502 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.617006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.618887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.645654 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1297/2585] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:10 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:10.650679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.660835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24c0ad-cce6-4497-b368-ba37a2c1ecfc admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.672783 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:10.720117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.720889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.721180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.721625 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.722314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.724308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.743924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1289/2586] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:10 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:10.748037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.759110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cbac2-03ee-464c-a6b9-720b324838e7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.763960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.764668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.764970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.765250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.766043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.767914 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.778515 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1298/2587] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:10.782567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.792267 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ecf3-f9fe-4108-b965-38567e409933 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.796798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61776472-b478-4241-b304-fe8a27b30ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.797441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776472-b478-4241-b304-fe8a27b30ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.797727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776472-b478-4241-b304-fe8a27b30ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.798006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61776472-b478-4241-b304-fe8a27b30ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.798732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61776472-b478-4241-b304-fe8a27b30ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.800362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61776472-b478-4241-b304-fe8a27b30ec8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.810644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1290/2588] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:10.814499 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:10.825008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1707be-8962-4826-96b8-373bc4a88dc9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:10.829659 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:10.830533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.830824 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.831102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] PATH_INFO: `/v3/projects/cabd19ae41a04fe38a5acd46c4176a2b/users/06b1641756974d9b874ce3b147102a31/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.843946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:10.847300 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabd19ae41a04fe38a5acd46c4176a2b, user_id=06b1641756974d9b874ce3b147102a31, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:10.850671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:10.863831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1299/2589] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:10 2022] PUT /identity/v3/projects/cabd19ae41a04fe38a5acd46c4176a2b/users/06b1641756974d9b874ce3b147102a31/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:10.874985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:10.875275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:10.875550 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:10.901792 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] MFA Rules not processed for user `06b1641756974d9b874ce3b147102a31`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:10.902914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:10.966359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1291/2590] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:10.970788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.032365 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40405bc-0daa-4338-aea8-ac90dc042822 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.037077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.037730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.038506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.038784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.039481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.041410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.066432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1300/2591] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:10 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:11.070350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.081311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9aa7-9bde-4f29-a2a0-76e472aef47e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.141478 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.142139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.142421 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.142693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.143375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.145305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.165567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1292/2592] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:11 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:11.169446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.180506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4611342-4b7b-43bb-9db9-2ec89a874e38 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.185128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.185776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.186060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.186337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.187055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.188689 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.199037 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1301/2593] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:11.202822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.212569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131ef0f-7c05-40df-9089-2ad429c1e96a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.217165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61912bb5-f5b4-43f4-80aa-c7fecd990e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.217811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61912bb5-f5b4-43f4-80aa-c7fecd990e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.218096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61912bb5-f5b4-43f4-80aa-c7fecd990e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.218372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61912bb5-f5b4-43f4-80aa-c7fecd990e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.219096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61912bb5-f5b4-43f4-80aa-c7fecd990e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.220715 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61912bb5-f5b4-43f4-80aa-c7fecd990e00 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.230947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1293/2594] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:11.234635 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.245270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9494f4-48c0-4087-8218-3c09fc6605e0 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.249858 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.250724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.251006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.251284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] PATH_INFO: `/v3/projects/b2028669842a4646adccd7a5a5766158/users/f5ef7da4f48941cabf0297ab96d71f96/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.266015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2028669842a4646adccd7a5a5766158, user_id=f5ef7da4f48941cabf0297ab96d71f96, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.268670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.282388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1302/2595] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:11 2022] PUT /identity/v3/projects/b2028669842a4646adccd7a5a5766158/users/f5ef7da4f48941cabf0297ab96d71f96/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:11.293216 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.293513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.293794 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.300592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:11.322445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] MFA Rules not processed for user `f5ef7da4f48941cabf0297ab96d71f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:11.323649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:11.386171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1294/2596] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:11.390608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.450293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf3ed2-db70-4875-8b4b-1bb706569892 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.454852 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.455503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.455788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.456098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.456794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.458688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.483707 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1303/2597] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:11 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:11.487650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.498847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48badf64-6372-4b63-8df0-a37d89f6103e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.557061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.557747 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.557999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.558273 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.558964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.560923 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.584456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1295/2598] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:11 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:11.586255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.596691 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff7d3-aa00-425a-b0bd-05986ffd3266 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.602241 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.602907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.603217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.603497 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.604262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.605851 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.618085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1304/2599] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:11.622663 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.633104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c7bac-7504-47a5-8ce6-899258b146cd admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.638414 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.639378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.639561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.639846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] PATH_INFO: `/v3/projects/b76842408f944c0e83b94e3974f720f6/users/e06cf759e852428e9605e01345e58193/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.656429 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76842408f944c0e83b94e3974f720f6, user_id=e06cf759e852428e9605e01345e58193, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.659104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.673509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1296/2600] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:11 2022] PUT /identity/v3/projects/b76842408f944c0e83b94e3974f720f6/users/e06cf759e852428e9605e01345e58193/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:11.677696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.687747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cef9dd-da4f-4e80-bc0e-c8dbb1534bdf admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.710639 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:11.756383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c5550-a8b5-4f28-ba30-d6fb98c73772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.757638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5550-a8b5-4f28-ba30-d6fb98c73772 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.758006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5550-a8b5-4f28-ba30-d6fb98c73772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.758331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5550-a8b5-4f28-ba30-d6fb98c73772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.759232 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5550-a8b5-4f28-ba30-d6fb98c73772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.761034 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5550-a8b5-4f28-ba30-d6fb98c73772 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.771509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1305/2601] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:11.776215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.786676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ff18-2648-41ff-9f8b-6afacab4a65c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:11.791880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:11.792816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.793096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.793370 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] PATH_INFO: `/v3/projects/b76842408f944c0e83b94e3974f720f6/users/e06cf759e852428e9605e01345e58193/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.797670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76842408f944c0e83b94e3974f720f6, user_id=e06cf759e852428e9605e01345e58193, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:11.800511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:11.814967 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1297/2602] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:11 2022] PUT /identity/v3/projects/b76842408f944c0e83b94e3974f720f6/users/e06cf759e852428e9605e01345e58193/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:11.826841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:11.827136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:11.827416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:11.858978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] MFA Rules not processed for user `e06cf759e852428e9605e01345e58193`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:11.860164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:11.935379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1306/2603] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:11.948795 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:11.951042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:12.016304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:12.022068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df106192-7417-4a26-ae76-3457e8ae6948 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:12.031475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:12.032162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:12.040808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:12.040808 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:12.098835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:12.100280 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:12.109857 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1298/2604] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:13.613988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:13.616949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:13.630419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d751f-0d84-4b36-9c82-3b5ff5c43e32 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:13.634837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:13.635492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:13.635776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:13.636084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:13.699610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:13.701137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:13.712589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1307/2605] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:14.311571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:14.322292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d44d34-3594-4f3e-b542-372367f2e09a service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:14.330058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a6dd-96b0-4c02-8355-8a6b9a4a9c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:14.330896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a6dd-96b0-4c02-8355-8a6b9a4a9c00 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:14.331335 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a6dd-96b0-4c02-8355-8a6b9a4a9c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:14.331766 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a6dd-96b0-4c02-8355-8a6b9a4a9c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:14.343855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a6dd-96b0-4c02-8355-8a6b9a4a9c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:14.345911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a6dd-96b0-4c02-8355-8a6b9a4a9c00 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:14.358215 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1299/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:18.218995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:18.261027 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:18.283806 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658801f0-3079-496c-adbd-9f768e3125e2 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:18.288739 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:18.289603 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:18.289887 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:18.290159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] PATH_INFO: `/v3/users/06b1641756974d9b874ce3b147102a31` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:18.291339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b1641756974d9b874ce3b147102a31)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:18.293339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:18.345728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b1641756974d9b874ce3b147102a31'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.365315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b1641756974d9b874ce3b147102a31'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.375516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b1641756974d9b874ce3b147102a31'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.383383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b1641756974d9b874ce3b147102a31'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.384075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b1641756974d9b874ce3b147102a31'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.390531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1308/2607] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:18 2022] DELETE /identity/v3/users/06b1641756974d9b874ce3b147102a31 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:18.394719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:18.395191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:18.395276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:18.412139 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:18.413994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:18.474451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1300/2608] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:18.484972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:18.486605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:18.548528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f4992-e5be-4779-9037-746850906e25 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:18.553285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:18.554582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:18.555077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:18.555480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:18.565987 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:18.567492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:18.577802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1309/2609] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:18.866162 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:18.867870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:18.881771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbc706-dd02-459b-a1b9-3a55079745ac None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:18.886581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:18.887456 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:18.887765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:18.888073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] PATH_INFO: `/v3/projects/cabd19ae41a04fe38a5acd46c4176a2b` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:18.889989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabd19ae41a04fe38a5acd46c4176a2b)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:18.891920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:18.941469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabd19ae41a04fe38a5acd46c4176a2b', 'request_id': 'req-b122781a-dc8e-4fb9-adfe-54355aeaae9b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.947567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabd19ae41a04fe38a5acd46c4176a2b', 'request_id': 'req-b122781a-dc8e-4fb9-adfe-54355aeaae9b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.954874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabd19ae41a04fe38a5acd46c4176a2b', 'request_id': 'req-b122781a-dc8e-4fb9-adfe-54355aeaae9b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.965737 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] The token cache is being invalidate because project cabd19ae41a04fe38a5acd46c4176a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:18.966006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.966642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:18.968203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1301/2610] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:18 2022] DELETE /identity/v3/projects/cabd19ae41a04fe38a5acd46c4176a2b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:18.972124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:18.982266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97906bb4-b054-4225-b6f8-142aaade20a9 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:19.034029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:19.041377 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:19.042263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:19.042860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:19.043186 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] PATH_INFO: `/v3/users/f5ef7da4f48941cabf0297ab96d71f96` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:19.044915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ef7da4f48941cabf0297ab96d71f96)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:19.046917 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:19.090724 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ef7da4f48941cabf0297ab96d71f96'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.103152 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ef7da4f48941cabf0297ab96d71f96'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.110408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ef7da4f48941cabf0297ab96d71f96'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.117628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ef7da4f48941cabf0297ab96d71f96'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.118187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ef7da4f48941cabf0297ab96d71f96'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.123962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1310/2611] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:18 2022] DELETE /identity/v3/users/f5ef7da4f48941cabf0297ab96d71f96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:19.382518 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:19.384762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:19.400408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122781a-dc8e-4fb9-adfe-54355aeaae9b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:19.409539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:19.460045 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:19.460892 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:19.461712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:19.461971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] PATH_INFO: `/v3/projects/b2028669842a4646adccd7a5a5766158` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:19.463129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2028669842a4646adccd7a5a5766158)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:19.465091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:19.510701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2028669842a4646adccd7a5a5766158', 'request_id': 'req-3d9da1ae-a226-4cbb-a774-50c42a7b539b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.516718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2028669842a4646adccd7a5a5766158', 'request_id': 'req-3d9da1ae-a226-4cbb-a774-50c42a7b539b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.523573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2028669842a4646adccd7a5a5766158', 'request_id': 'req-3d9da1ae-a226-4cbb-a774-50c42a7b539b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.533646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] The token cache is being invalidate because project b2028669842a4646adccd7a5a5766158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:19.533929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.534543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.536115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1302/2612] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:19 2022] DELETE /identity/v3/projects/b2028669842a4646adccd7a5a5766158 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:19.540072 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:19.541463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:19.554020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee80d49-4700-46c1-aad2-88eb82203551 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:19.608554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:19.609415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:19.609695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:19.609965 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] PATH_INFO: `/v3/users/e06cf759e852428e9605e01345e58193` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:19.611123 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06cf759e852428e9605e01345e58193)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:19.613060 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:19.658075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06cf759e852428e9605e01345e58193'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.669877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06cf759e852428e9605e01345e58193'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.678721 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06cf759e852428e9605e01345e58193'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.684429 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:19.686697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06cf759e852428e9605e01345e58193'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.688077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06cf759e852428e9605e01345e58193'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:19.696128 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1311/2613] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:19 2022] DELETE /identity/v3/users/e06cf759e852428e9605e01345e58193 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:19.968680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:19.970592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:19.985391 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9da1ae-a226-4cbb-a774-50c42a7b539b admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:20.043647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:20.044536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:20.044816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:20.045089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] PATH_INFO: `/v3/projects/b76842408f944c0e83b94e3974f720f6` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:20.046254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76842408f944c0e83b94e3974f720f6)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:20.048191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:20.090209 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:20.094486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76842408f944c0e83b94e3974f720f6', 'request_id': 'req-2a086660-f8a6-4c43-9479-4394f784786d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:20.102986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76842408f944c0e83b94e3974f720f6', 'request_id': 'req-2a086660-f8a6-4c43-9479-4394f784786d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:20.111054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76842408f944c0e83b94e3974f720f6', 'request_id': 'req-2a086660-f8a6-4c43-9479-4394f784786d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:20.122700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] The token cache is being invalidate because project b76842408f944c0e83b94e3974f720f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:20.122988 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:20.123607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:20.125204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1303/2614] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:19 2022] DELETE /identity/v3/projects/b76842408f944c0e83b94e3974f720f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:29.693605 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:30.119583 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:36.035812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:36.037335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:36.101695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb4d8c-55f8-4cdc-8971-fd0a370dfbd9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:36.159747 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:36.160715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:36.161288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:36.161582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:36.163692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:36.232732 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:36.234362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:36.245062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1312/2615] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:06:39.386085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:39.387541 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:39.400681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086660-f8a6-4c43-9479-4394f784786d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:39.405299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:39.406167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:39.406450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:39.406727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] PATH_INFO: `/v3/users/bf85b80a4bb747da9bd07454536380c0` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:39.407928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf85b80a4bb747da9bd07454536380c0)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:39.409900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:39.457745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf85b80a4bb747da9bd07454536380c0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.469873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf85b80a4bb747da9bd07454536380c0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.470522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf85b80a4bb747da9bd07454536380c0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.477324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf85b80a4bb747da9bd07454536380c0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.484757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-879d8d59-930c-4285-88ed-01bc1180aa6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf85b80a4bb747da9bd07454536380c0'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.491381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1304/2616] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:39 2022] DELETE /identity/v3/users/bf85b80a4bb747da9bd07454536380c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:39.672920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:39.683389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839e1bb-827e-4dd9-8f8e-0ff93e5a68a3 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:39.738326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:39.739204 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:39.739482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:39.739753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] PATH_INFO: `/v3/projects/318fe395ab574501973a3a20d0c77bfc` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:39.740966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318fe395ab574501973a3a20d0c77bfc)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:39.743133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:39.751181 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:39.787326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318fe395ab574501973a3a20d0c77bfc', 'request_id': 'req-b92f645d-934d-49e1-b497-e3fbeaaab806'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.793325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318fe395ab574501973a3a20d0c77bfc', 'request_id': 'req-b92f645d-934d-49e1-b497-e3fbeaaab806'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.800338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318fe395ab574501973a3a20d0c77bfc', 'request_id': 'req-b92f645d-934d-49e1-b497-e3fbeaaab806'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.813634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] The token cache is being invalidate because project 318fe395ab574501973a3a20d0c77bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:39.813919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.814539 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-b92f645d-934d-49e1-b497-e3fbeaaab806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:39.816084 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1313/2617] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:39 2022] DELETE /identity/v3/projects/318fe395ab574501973a3a20d0c77bfc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:39.821187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:39.821475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:39.821782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:39.841911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:39.843034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:39.900259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1305/2618] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:39.908052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:39.908350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:39.908638 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:39.928273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:39.929495 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:39.939001 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1314/2619] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:39.944123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:39.954237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f4f32-41ec-45f9-9d8a-cb5cb5e0e5ee None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:39.958957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:39.959631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:39.959915 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:39.960224 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:39.960948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:39.961258 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:39.962838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:39.974272 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1306/2620] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:39.978303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:39.987384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93c0f8-b7a4-4fe3-9728-8299ede70df9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:39.992261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:39.992928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:39.993211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:39.993490 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:39.994184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:39.996591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:40.021444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1315/2621] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:39 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:40.025581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:40.035308 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c6a7b-3741-428b-b1d0-d46e2854ca58 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:40.088948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:40.089633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:40.089920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:40.090195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:40.090880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:40.092925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:40.099584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:40.115358 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1307/2622] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:40 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:40.119764 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:40.130421 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69ac08-20ad-4bfb-b7a0-385de76d8175 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:40.134920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:40.135564 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:40.135842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:40.136153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:40.136866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:40.138441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:40.148588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1316/2623] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:40.152191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:40.161751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340abf42-33ea-4c22-b36e-4661692be196 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:40.166257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500a449-8df0-4668-91b5-9331da8922e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:40.166890 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500a449-8df0-4668-91b5-9331da8922e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:40.167660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500a449-8df0-4668-91b5-9331da8922e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:40.167932 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500a449-8df0-4668-91b5-9331da8922e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:40.168674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500a449-8df0-4668-91b5-9331da8922e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:40.170223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500a449-8df0-4668-91b5-9331da8922e0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:40.179822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1308/2624] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:40.184225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:40.193995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53c35e-c61b-48bf-aba3-b53cec069f1e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:40.198608 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:40.199474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:40.199755 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:40.200064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] PATH_INFO: `/v3/projects/b2ee6b4499724018b2145752014e1330/users/5ceaeb1a3ec54e998429d4dacfd2aaaf/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:40.215457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ee6b4499724018b2145752014e1330, user_id=5ceaeb1a3ec54e998429d4dacfd2aaaf, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:40.218097 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:40.231277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1317/2625] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:40 2022] PUT /identity/v3/projects/b2ee6b4499724018b2145752014e1330/users/5ceaeb1a3ec54e998429d4dacfd2aaaf/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:40.241167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:40.241449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:40.241729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:40.268447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] MFA Rules not processed for user `5ceaeb1a3ec54e998429d4dacfd2aaaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:40.269653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:40.332457 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1309/2626] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:40.343666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:40.345297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:40.418153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d990b-1322-4100-91d7-754f398feda9 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:40.423726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bff53-64f7-4543-9bef-2e56182b5cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:40.424392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bff53-64f7-4543-9bef-2e56182b5cb3 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:40.424679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bff53-64f7-4543-9bef-2e56182b5cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:40.424959 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bff53-64f7-4543-9bef-2e56182b5cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:40.432569 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bff53-64f7-4543-9bef-2e56182b5cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:40.434169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bff53-64f7-4543-9bef-2e56182b5cb3 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:40.443199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1318/2627] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:43.107885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:43.173649 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02164e-2712-4f56-8e48-99094cda9913 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:43.178219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:43.179086 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.179366 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.179642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] PATH_INFO: `/v3/users/5ceaeb1a3ec54e998429d4dacfd2aaaf` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.180852 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ceaeb1a3ec54e998429d4dacfd2aaaf)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:43.183390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:43.227846 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ceaeb1a3ec54e998429d4dacfd2aaaf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.240061 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ceaeb1a3ec54e998429d4dacfd2aaaf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.240722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ceaeb1a3ec54e998429d4dacfd2aaaf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.245994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:43.249862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ceaeb1a3ec54e998429d4dacfd2aaaf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.257552 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ceaeb1a3ec54e998429d4dacfd2aaaf'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.263487 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1310/2628] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:43 2022] DELETE /identity/v3/users/5ceaeb1a3ec54e998429d4dacfd2aaaf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:43.268020 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.268508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.268622 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.285267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:43.286534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:43.298728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:43.349547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1319/2629] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:43.360195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:43.361610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:43.421934 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ec1d-ac4f-440b-a14f-6a576e2ee104 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:43.425874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a7cff-997d-41e4-af85-d6093daec6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:43.426498 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7cff-997d-41e4-af85-d6093daec6be service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.426771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7cff-997d-41e4-af85-d6093daec6be service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.427047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a7cff-997d-41e4-af85-d6093daec6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.436511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7cff-997d-41e4-af85-d6093daec6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:43.437951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a7cff-997d-41e4-af85-d6093daec6be service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:43.447820 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1311/2630] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:43.716257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:43.717670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:43.732090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756e2c-d390-475e-bcb8-059de978e18c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:43.737098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:43.738211 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.738396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.738683 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] PATH_INFO: `/v3/projects/b2ee6b4499724018b2145752014e1330` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.739872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ee6b4499724018b2145752014e1330)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:43.741836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:43.788519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ee6b4499724018b2145752014e1330', 'request_id': 'req-05fa1302-a22e-4493-9a05-05775c71b4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.794890 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ee6b4499724018b2145752014e1330', 'request_id': 'req-05fa1302-a22e-4493-9a05-05775c71b4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.801427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ee6b4499724018b2145752014e1330', 'request_id': 'req-05fa1302-a22e-4493-9a05-05775c71b4fe'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.812341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] The token cache is being invalidate because project b2ee6b4499724018b2145752014e1330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:43.812652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.813285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-05fa1302-a22e-4493-9a05-05775c71b4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:43.814835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1320/2631] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:43 2022] DELETE /identity/v3/projects/b2ee6b4499724018b2145752014e1330 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:43.819903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.820292 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.820636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.838503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:43.840353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:43.897874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1312/2632] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:43.906071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.906360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.906644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.924554 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:43.925757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:43.933844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1321/2633] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:43.938103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:43.947805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04909eb5-d4c8-464d-af14-12e3c22062e5 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:43.954179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:43.954829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.955114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.955392 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.956165 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:43.956476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:43.958060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:43.970334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1313/2634] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:43.974647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:43.983777 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3031e7-0f0f-4cfc-a5c5-284cf73ec6aa None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:43.988985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:43.989615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:43.989895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:43.990175 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:43.990873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:43.993033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.020372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1322/2635] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:43 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:44.024579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.035177 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159209-7211-493c-a21b-420e02dd19b6 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.094324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.095378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.095839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.096149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.096882 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.098801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.121377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1314/2636] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:44 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:44.125572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.137166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a41ce-8c04-4ddc-a073-53c11e09718d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.142279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.142933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.143212 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.143482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.144240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.145915 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.158172 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1323/2637] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:44.161957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.173761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7bd47-135b-40c1-8f60-e7b5555e95ac admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.179271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64778c1c-787b-4f32-aca9-bc09790a4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.180053 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778c1c-787b-4f32-aca9-bc09790a4714 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.180412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778c1c-787b-4f32-aca9-bc09790a4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.180757 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64778c1c-787b-4f32-aca9-bc09790a4714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.181565 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64778c1c-787b-4f32-aca9-bc09790a4714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.184038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64778c1c-787b-4f32-aca9-bc09790a4714 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.185897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:44.200149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1315/2638] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:44.202618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.214178 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe36f4b-5574-4224-bf59-a65a7a4f0154 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.222644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.223671 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.224068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.224417 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] PATH_INFO: `/v3/projects/fa24ecda9f3d47d5bab96ff9aaa98653/users/b6429d701366473889a338b18408d7ae/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.241460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa24ecda9f3d47d5bab96ff9aaa98653, user_id=b6429d701366473889a338b18408d7ae, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.244491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.264009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1324/2639] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:44 2022] PUT /identity/v3/projects/fa24ecda9f3d47d5bab96ff9aaa98653/users/b6429d701366473889a338b18408d7ae/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:44.270769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.271125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.271517 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.304621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] MFA Rules not processed for user `b6429d701366473889a338b18408d7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:44.305854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.383410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1316/2640] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:44.396853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.398950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.444929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:44.487323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74784bf-6a06-4b64-bd2d-03481d086d90 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.496250 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.497276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.497737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.498403 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.510346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.512687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.523507 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1325/2641] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:44.596823 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.598207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.685101 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde920f-1143-4118-8137-0d058d075cd0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.699038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.700184 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.700471 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.700780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] PATH_INFO: `/v3/users/6c05f60b698343d483a6e91c152965d4` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.702657 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c05f60b698343d483a6e91c152965d4)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.704968 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.748874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.758706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5154f91-8386-4635-9e3b-727016d596d9 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.763487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:44.764391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.764673 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.764945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] PATH_INFO: `/v3/users/b6429d701366473889a338b18408d7ae` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.766130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6429d701366473889a338b18408d7ae)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:44.766282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c05f60b698343d483a6e91c152965d4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.768061 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:44.780688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c05f60b698343d483a6e91c152965d4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.781408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c05f60b698343d483a6e91c152965d4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.789110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c05f60b698343d483a6e91c152965d4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.797680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8cda0506-3381-4dcf-abf6-fe45a6fd6c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c05f60b698343d483a6e91c152965d4'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.804502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1317/2642] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:44 2022] DELETE /identity/v3/users/6c05f60b698343d483a6e91c152965d4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:44.809440 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.809727 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.810019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.816273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6429d701366473889a338b18408d7ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.816434 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:44.827945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:44.829337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6429d701366473889a338b18408d7ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.829818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.836453 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6429d701366473889a338b18408d7ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.843533 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6429d701366473889a338b18408d7ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.844293 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-70ca2bea-fea0-41b4-8a86-5133c5602a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6429d701366473889a338b18408d7ae'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:44.850194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1326/2643] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:44 2022] DELETE /identity/v3/users/b6429d701366473889a338b18408d7ae => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:44.854460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:44.855271 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:44.855582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:44.873270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:44.874473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.888945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1318/2644] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:44.898697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.900192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.933340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1327/2645] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:44.945270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:44.946451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:44.959298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ca4eb-4c9f-473e-99fc-cb56e063f668 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:44.986298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:45.006302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56864c32-85b8-463f-bb38-80f22870cfb9 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.009275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.009929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.010039 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.010231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.010486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.010669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.010956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.011239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.020070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.020362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.021555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.021782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.032425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1319/2647] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:06:45.036038 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1328/2647] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:45.417698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.419387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:45.440690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33020a-7380-41d0-afbe-392e984e2745 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.446114 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.447111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.447532 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.447917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] PATH_INFO: `/v3/projects/fa24ecda9f3d47d5bab96ff9aaa98653` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.449710 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa24ecda9f3d47d5bab96ff9aaa98653)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.451953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.460946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.462389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:45.477478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1362531-c7ed-45c1-b127-f24295e0ca7e service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.482911 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.483783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.484105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.484388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] PATH_INFO: `/v3/projects/3f3cd19473fe43218be0bd6a0e0f62cb` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.485754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3cd19473fe43218be0bd6a0e0f62cb)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.487896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.509641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa24ecda9f3d47d5bab96ff9aaa98653', 'request_id': 'req-d636acd2-2a07-4749-aa6a-9123b32c9f77'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.517253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa24ecda9f3d47d5bab96ff9aaa98653', 'request_id': 'req-d636acd2-2a07-4749-aa6a-9123b32c9f77'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.521263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:45.525746 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa24ecda9f3d47d5bab96ff9aaa98653', 'request_id': 'req-d636acd2-2a07-4749-aa6a-9123b32c9f77'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.539232 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] The token cache is being invalidate because project fa24ecda9f3d47d5bab96ff9aaa98653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:45.539531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.539728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3cd19473fe43218be0bd6a0e0f62cb', 'request_id': 'req-24cd6a2c-ff76-4a33-9797-2d58b7e99762'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.540235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d636acd2-2a07-4749-aa6a-9123b32c9f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.542691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1320/2648] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:45 2022] DELETE /identity/v3/projects/fa24ecda9f3d47d5bab96ff9aaa98653 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:45.546279 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3cd19473fe43218be0bd6a0e0f62cb', 'request_id': 'req-24cd6a2c-ff76-4a33-9797-2d58b7e99762'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.547381 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d1bc4-3046-46b2-b8a3-6d7f49aa35ed None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.547653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d1bc4-3046-46b2-b8a3-6d7f49aa35ed None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.547958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d1bc4-3046-46b2-b8a3-6d7f49aa35ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.554366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3cd19473fe43218be0bd6a0e0f62cb', 'request_id': 'req-24cd6a2c-ff76-4a33-9797-2d58b7e99762'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.565523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] The token cache is being invalidate because project 3f3cd19473fe43218be0bd6a0e0f62cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:45.565812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.566438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.566761 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ed7d1bc4-3046-46b2-b8a3-6d7f49aa35ed None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:45.567986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ed7d1bc4-3046-46b2-b8a3-6d7f49aa35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:45.568434 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1329/2649] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:45 2022] DELETE /identity/v3/projects/3f3cd19473fe43218be0bd6a0e0f62cb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:45.572110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.573956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:45.628536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1321/2650] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:45.636705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.637001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.637281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.640262 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6a2c-ff76-4a33-9797-2d58b7e99762 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.644893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.645766 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.646049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.646325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] PATH_INFO: `/v3/users/de55d08298d4487cba9fb1f18b06199e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.647525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de55d08298d4487cba9fb1f18b06199e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.649494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.655463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:45.656689 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:45.664906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1322/2651] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:45.669042 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.678880 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404d33-507c-4195-8b79-b6fdfbc7d691 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.684735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.685402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.685674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.685952 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.686670 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:45.686981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.688616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.697094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de55d08298d4487cba9fb1f18b06199e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.701211 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1323/2652] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:06:45.705975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.711993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:45.714576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de55d08298d4487cba9fb1f18b06199e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.716416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167d385-ed91-43de-9437-da55b5303780 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.722905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.723831 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.724296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.724460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de55d08298d4487cba9fb1f18b06199e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.724569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.725261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.727266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.732783 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de55d08298d4487cba9fb1f18b06199e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.733549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de55d08298d4487cba9fb1f18b06199e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:45.739809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1330/2653] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:45 2022] DELETE /identity/v3/users/de55d08298d4487cba9fb1f18b06199e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:45.755332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1324/2654] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:45 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:45.759473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.761552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:45.831881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad60d5e-6c93-4012-9bf3-dc5c267fa3f1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.889002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.890456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.891087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.891375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.892104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.894078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.914649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1331/2655] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:45 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:45.918975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.929192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd6976-9f5a-4069-8dcb-dc3a43f564d3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.934489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.935227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.935641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.935821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.936576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.938206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.952006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1325/2656] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:45.953425 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.963925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb292b-6f51-4cb4-889f-85ad90a1491f admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:45.968751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:45.969415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:45.969702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:45.969982 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:45.970711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:45.972354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:45.982456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1332/2657] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:45.986492 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:45.997328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba322a7-886a-44cf-9f02-71676ff142a8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.002233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dac7ed-22b8-4d64-a0ea-cf59c424671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.003119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac7ed-22b8-4d64-a0ea-cf59c424671a admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.003404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac7ed-22b8-4d64-a0ea-cf59c424671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.003680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac7ed-22b8-4d64-a0ea-cf59c424671a admin admin] PATH_INFO: `/v3/projects/534cd8c6aeaf4146901b1023ef8e7747/users/f2702fc090094e99b3ac6ddbba5188ff/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.021503 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dac7ed-22b8-4d64-a0ea-cf59c424671a admin admin] RBAC: Authorizing `identity:create_grant(project_id=534cd8c6aeaf4146901b1023ef8e7747, user_id=f2702fc090094e99b3ac6ddbba5188ff, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.026274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dac7ed-22b8-4d64-a0ea-cf59c424671a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.027445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.029393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.040671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1326/2658] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:45 2022] PUT /identity/v3/projects/534cd8c6aeaf4146901b1023ef8e7747/users/f2702fc090094e99b3ac6ddbba5188ff/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:46.043804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4eb59-da61-4c22-bb56-71cb1d411e28 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.051365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.051724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.052098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.080083 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] MFA Rules not processed for user `f2702fc090094e99b3ac6ddbba5188ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:46.081586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.104487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.105928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.106219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.106493 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] PATH_INFO: `/v3/projects/7d9fda6e35234a148796f69757a2f70e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.107679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9fda6e35234a148796f69757a2f70e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.109646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.118029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:46.151764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:46.155784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1327/2659] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:46.160592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.168335 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9fda6e35234a148796f69757a2f70e', 'request_id': 'req-a23c5b25-0469-4a83-b07a-5a5503541021'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:46.171712 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885d2cb-c253-45cd-96d6-25182d9732ef None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.175281 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9fda6e35234a148796f69757a2f70e', 'request_id': 'req-a23c5b25-0469-4a83-b07a-5a5503541021'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:46.182756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9fda6e35234a148796f69757a2f70e', 'request_id': 'req-a23c5b25-0469-4a83-b07a-5a5503541021'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:46.194809 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] The token cache is being invalidate because project 7d9fda6e35234a148796f69757a2f70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:46.195093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:46.195753 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-a23c5b25-0469-4a83-b07a-5a5503541021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:46.197337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1333/2660] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:46 2022] DELETE /identity/v3/projects/7d9fda6e35234a148796f69757a2f70e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:46.202958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03627ef-129a-4bc5-bf5c-313cba0c2455 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.203251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03627ef-129a-4bc5-bf5c-313cba0c2455 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.203531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03627ef-129a-4bc5-bf5c-313cba0c2455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.221148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e03627ef-129a-4bc5-bf5c-313cba0c2455 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:46.222379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e03627ef-129a-4bc5-bf5c-313cba0c2455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.232682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.233348 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.233658 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.233936 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.234622 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.236551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.262436 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1328/2661] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:46.266198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.267838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.283838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1334/2662] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:46.291375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.291668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.291956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.311140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:46.312468 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.330654 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae0b1f-2e7c-449f-8d0f-c749a032495c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.336019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.336686 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.336969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.337246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.337927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.339917 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.364765 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1329/2663] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:46.365810 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.373448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1335/2664] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:46.377474 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.379336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bee4be-8994-4cb3-bd01-12574d16e82e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.383993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.384646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.384927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.385203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.385951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.386348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78787fa6-fabd-46a3-ae37-e64cc8bc2e29 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.387519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.390972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.391611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.391893 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.392200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.392918 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:46.393225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.394928 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.400380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1330/2665] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:46.402137 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.407147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1336/2666] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:06:46.411237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.411900 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccea60-0fb0-4aa9-98d1-64fc9aee8c47 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.416618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.418044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.418838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.418838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] PATH_INFO: `/v3/projects/b7308342d8d14738b51723224b8824f0/users/e768a704cf2b481694bbc3b8c2630dff/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.425080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f49a3-26b3-4c0f-96a7-5db7a0d72c24 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.430983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.431743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.432077 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.432360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.433087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.433903 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7308342d8d14738b51723224b8824f0, user_id=e768a704cf2b481694bbc3b8c2630dff, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.434974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.436579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.450255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1331/2667] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:46 2022] PUT /identity/v3/projects/b7308342d8d14738b51723224b8824f0/users/e768a704cf2b481694bbc3b8c2630dff/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:46.454507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.461756 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1337/2668] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:46.466274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.470797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:46.499170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:46.520515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dddeb5-f7ce-4a7c-8028-52f6bfca5bb0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.532726 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0b878-84c8-4851-a01c-06092ff62e56 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.537410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.538483 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.538774 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.539055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.539745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.541696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.563759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1338/2669] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:46.567725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.577462 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2173-4a66-41f5-96b3-61e802d488bc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.581884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.582229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.582647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.582869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.582972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.583156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.583274 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.583437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.583916 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.584263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.585572 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.585869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.599311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1332/2670] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:46.599488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1339/2671] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:46.600386 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.603225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.610922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c6dfb-8f9b-4097-a4e6-2abf689d5090 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.613401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cb0db-779a-4bb9-8944-b43996ea855d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.615642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.616590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.616977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.617482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] PATH_INFO: `/v3/projects/b7308342d8d14738b51723224b8824f0/users/e768a704cf2b481694bbc3b8c2630dff/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.618534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef3c4f-a850-4c3e-890a-5f505fd34c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.619182 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3c4f-a850-4c3e-890a-5f505fd34c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.619467 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3c4f-a850-4c3e-890a-5f505fd34c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.619566 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7308342d8d14738b51723224b8824f0, user_id=e768a704cf2b481694bbc3b8c2630dff, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.619746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef3c4f-a850-4c3e-890a-5f505fd34c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.620560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef3c4f-a850-4c3e-890a-5f505fd34c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.622126 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef3c4f-a850-4c3e-890a-5f505fd34c2a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.622233 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.632418 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1333/2672] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:46 2022] PUT /identity/v3/projects/b7308342d8d14738b51723224b8824f0/users/e768a704cf2b481694bbc3b8c2630dff/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:46.642446 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1340/2673] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:46.642571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.644588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.644884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.645162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.672775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] MFA Rules not processed for user `e768a704cf2b481694bbc3b8c2630dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:46.674014 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.702175 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761822b7-5a4f-4099-b3e9-50f0c04abaa0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.706944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809dd593-b4fd-4dc8-b91e-bea251aa646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.707854 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dd593-b4fd-4dc8-b91e-bea251aa646b admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.708171 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dd593-b4fd-4dc8-b91e-bea251aa646b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.708451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809dd593-b4fd-4dc8-b91e-bea251aa646b admin admin] PATH_INFO: `/v3/projects/069a275973c6489dbc5659c479c5a887/users/b40ae3d95bc1420eba6bc8bf1f548903/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.727017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dd593-b4fd-4dc8-b91e-bea251aa646b admin admin] RBAC: Authorizing `identity:create_grant(project_id=069a275973c6489dbc5659c479c5a887, user_id=b40ae3d95bc1420eba6bc8bf1f548903, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.730676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809dd593-b4fd-4dc8-b91e-bea251aa646b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.745486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1334/2674] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:46 2022] PUT /identity/v3/projects/069a275973c6489dbc5659c479c5a887/users/b40ae3d95bc1420eba6bc8bf1f548903/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:46.747192 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1341/2675] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:46.761683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.761683 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.761945 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.767856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.769278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.788700 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] MFA Rules not processed for user `b40ae3d95bc1420eba6bc8bf1f548903`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:46.790118 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:46.824484 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3506b22-658d-4286-8823-c38bc2991941 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.832574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:46.833591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:46.858894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1335/2676] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:46.863519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.877171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.877825 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.878110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.878390 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.927772 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554c512-b6b9-4ac3-ac59-42f86c9ba707 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:46.932462 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:46.933160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:46.933446 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:46.933726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:46.934408 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.936539 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.941816 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:46.943463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:46.954326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1342/2677] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:06:46.964748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1336/2678] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:46.968867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:46.980743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceb279-7fc2-405d-a283-1a0ad47b10eb service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.031695 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.045680 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.046315 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.046598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.046873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.047573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.049520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.072187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1343/2679] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:46 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:47.074015 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.083677 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f35cb-3b99-4d75-8eef-719ceec21774 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.087950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb503a-2248-4f00-a331-db20bf6e1981 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.088522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.089844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.090127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.090402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.091134 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.092749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.093148 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.094029 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.094494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.094959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.096862 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:47.108226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1344/2680] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:47.112301 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.122631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d1dff-9541-4bee-9d85-09ba1d53c33c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.128416 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.129367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.129597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.129879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] PATH_INFO: `/v3/projects/9760056ec3b24d509747b41f3544c77f/users/f0bb5d9799014ed281f822d04927a30b/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.145122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9760056ec3b24d509747b41f3544c77f, user_id=f0bb5d9799014ed281f822d04927a30b, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.147846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.161203 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.161953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1345/2681] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:47 2022] PUT /identity/v3/projects/9760056ec3b24d509747b41f3544c77f/users/f0bb5d9799014ed281f822d04927a30b/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:47.164998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.165958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.171789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1337/2682] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:47.184523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:47.232314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fa733-ebd2-46c8-b199-6103683bbf5b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.237412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cbced-a230-4ba8-8177-9d8f39821fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.238091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cbced-a230-4ba8-8177-9d8f39821fda admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.238388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cbced-a230-4ba8-8177-9d8f39821fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.238702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cbced-a230-4ba8-8177-9d8f39821fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.239529 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cbced-a230-4ba8-8177-9d8f39821fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.241145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cbced-a230-4ba8-8177-9d8f39821fda admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.253867 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1346/2683] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:47.258034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.273809 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb1bff-dbfd-41a5-9764-4d543867da5e service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.280494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.281556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.281933 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.282327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] PATH_INFO: `/v3/projects/9760056ec3b24d509747b41f3544c77f/users/f0bb5d9799014ed281f822d04927a30b/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.284947 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9760056ec3b24d509747b41f3544c77f, user_id=f0bb5d9799014ed281f822d04927a30b, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.287909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.301136 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1338/2684] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:47 2022] PUT /identity/v3/projects/9760056ec3b24d509747b41f3544c77f/users/f0bb5d9799014ed281f822d04927a30b/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:47.312169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.312464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.312784 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.340043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] MFA Rules not processed for user `f0bb5d9799014ed281f822d04927a30b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:47.341263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:47.414791 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1347/2685] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:47.426205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.436959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:47.482332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68291571-14ff-4993-ad25-b1ad64d065ea admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.485965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff90e6b-c7fa-44ac-98a3-a3a6ad8f88fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.486595 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90e6b-c7fa-44ac-98a3-a3a6ad8f88fc service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.486877 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90e6b-c7fa-44ac-98a3-a3a6ad8f88fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.487153 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90e6b-c7fa-44ac-98a3-a3a6ad8f88fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.496983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff90e6b-c7fa-44ac-98a3-a3a6ad8f88fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.498443 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff90e6b-c7fa-44ac-98a3-a3a6ad8f88fc service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.509219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1339/2686] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:47.574366 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.636379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f22a-41d2-4b77-9461-dc7cf71c3195 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.640910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.641788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.642068 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.642351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] PATH_INFO: `/v3/users/b40ae3d95bc1420eba6bc8bf1f548903` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.643538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40ae3d95bc1420eba6bc8bf1f548903)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.645487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.688536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:47.695385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40ae3d95bc1420eba6bc8bf1f548903'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:47.707200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40ae3d95bc1420eba6bc8bf1f548903'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:47.714348 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40ae3d95bc1420eba6bc8bf1f548903'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:47.721124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40ae3d95bc1420eba6bc8bf1f548903'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:47.721752 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40ae3d95bc1420eba6bc8bf1f548903'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:47.727602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1348/2687] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:47 2022] DELETE /identity/v3/users/b40ae3d95bc1420eba6bc8bf1f548903 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:47.732558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.732836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.733115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.751393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:47.752610 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:47.808996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1340/2688] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:47.818353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:47.819771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:47.875818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ea1d2-fddb-43a2-9c96-6fe543b510bd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:47.879481 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:47.880151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:47.880437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:47.880713 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:47.889611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:47.891029 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:47.900518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1349/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:48.163536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:48.165004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:48.178875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527adc5a-afb2-4fd7-ae51-97ae8a488bf4 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:48.183463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:48.184909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:48.185365 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:48.185647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] PATH_INFO: `/v3/projects/069a275973c6489dbc5659c479c5a887` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:48.186834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=069a275973c6489dbc5659c479c5a887)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:48.188818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:48.234109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069a275973c6489dbc5659c479c5a887', 'request_id': 'req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.240097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069a275973c6489dbc5659c479c5a887', 'request_id': 'req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.247554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069a275973c6489dbc5659c479c5a887', 'request_id': 'req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.257844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] The token cache is being invalidate because project 069a275973c6489dbc5659c479c5a887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:48.258154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.258775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.260351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1341/2690] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:48 2022] DELETE /identity/v3/projects/069a275973c6489dbc5659c479c5a887 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:48.264759 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:48.274373 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50490-7882-423f-9f2a-226cffa6d360 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:48.333164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:48.334041 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:48.334328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:48.334722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] PATH_INFO: `/v3/users/f0bb5d9799014ed281f822d04927a30b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:48.335999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bb5d9799014ed281f822d04927a30b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:48.337843 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:48.389634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bb5d9799014ed281f822d04927a30b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.400132 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:48.403280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bb5d9799014ed281f822d04927a30b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.411797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bb5d9799014ed281f822d04927a30b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.419052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bb5d9799014ed281f822d04927a30b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.419704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-606919fa-31c4-4835-86e5-e084fa68610d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bb5d9799014ed281f822d04927a30b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.433705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1350/2691] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:48 2022] DELETE /identity/v3/users/f0bb5d9799014ed281f822d04927a30b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:48.738588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:48.740225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:48.754874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b4ca4-450b-47fb-88a4-d8696e55c63a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:48.788460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:48.814271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:48.815132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:48.815417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:48.815696 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] PATH_INFO: `/v3/projects/9760056ec3b24d509747b41f3544c77f` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:48.816911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9760056ec3b24d509747b41f3544c77f)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:48.818821 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:48.863195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9760056ec3b24d509747b41f3544c77f', 'request_id': 'req-e6cbd199-9903-467c-944b-7f083687502b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.869297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9760056ec3b24d509747b41f3544c77f', 'request_id': 'req-e6cbd199-9903-467c-944b-7f083687502b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.876838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9760056ec3b24d509747b41f3544c77f', 'request_id': 'req-e6cbd199-9903-467c-944b-7f083687502b'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.887515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] The token cache is being invalidate because project 9760056ec3b24d509747b41f3544c77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:48.887800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.888450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-e6cbd199-9903-467c-944b-7f083687502b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:48.889957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1342/2692] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:48 2022] DELETE /identity/v3/projects/9760056ec3b24d509747b41f3544c77f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:48.894822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:48.895275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:48.895391 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:48.912402 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:48.913586 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:48.978022 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1351/2693] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:48.986480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:48.986849 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:48.987129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.006109 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:49.007325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:49.016030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1343/2694] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:49.020316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.029968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f70f7-fd3e-470f-95e5-ba6132ebf6db None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.034581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.035203 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.035498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.035778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.036550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:49.036861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.038443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.050370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1352/2695] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:49.054569 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.064976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e41af-09e5-4e89-8f9d-bc80484c0b1d None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.069827 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.070475 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.070760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.071039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.071721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.073667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.099126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1344/2696] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:49 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:49.103267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.113749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1a622-348f-416f-ab98-651d9d2c3d46 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.169091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.169798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.170082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.170358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.171049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.172999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.192620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1353/2697] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:49 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:49.196739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.207205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f286-c373-448e-82ea-ca0fa09645e5 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.211870 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.212581 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.212869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.213149 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.213874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.215660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.226205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1345/2698] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:49.230517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.240194 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec26b6-24f7-46fd-962b-57f178cef446 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.245108 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb9bf-baa7-4406-bf00-3e6855802840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.246392 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb9bf-baa7-4406-bf00-3e6855802840 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.246681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb9bf-baa7-4406-bf00-3e6855802840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.246989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb9bf-baa7-4406-bf00-3e6855802840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.247715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bb9bf-baa7-4406-bf00-3e6855802840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.249330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bb9bf-baa7-4406-bf00-3e6855802840 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.258962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1354/2699] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:49.262773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.272597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b305878-9162-49a9-8b95-0df290d7756a admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.277260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.278129 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.278412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.278691 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] PATH_INFO: `/v3/projects/e0f3ebaf5e3e4955b9480a55e21db5ad/users/cb1ca115db544d6e9c80fa1aa55f675d/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.293576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f3ebaf5e3e4955b9480a55e21db5ad, user_id=cb1ca115db544d6e9c80fa1aa55f675d, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.296257 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.309201 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1346/2700] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:49 2022] PUT /identity/v3/projects/e0f3ebaf5e3e4955b9480a55e21db5ad/users/cb1ca115db544d6e9c80fa1aa55f675d/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:49.320451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.320746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.321030 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.346891 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] MFA Rules not processed for user `cb1ca115db544d6e9c80fa1aa55f675d`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:49.348130 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:49.380933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:49.413628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1355/2701] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:49.418629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.477767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbed30-4675-444c-a51b-18451edbc380 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.483023 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.483660 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.483939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.484243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.484924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.486796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.490681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:49.512896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1347/2702] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:49 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:49.516898 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.528448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14378792-77db-4a72-9ca5-8e6750f18c7c None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.582720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.583388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.583678 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.583960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.584675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.586590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.606579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1356/2703] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:49 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:49.610611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.621012 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f60640-5e07-477b-84f0-dd09f8802b5e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.625661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.626313 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.626598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.626878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.627597 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.629223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.639611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1348/2704] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:49.643688 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.654110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd811-eefc-4070-ad76-80305c460360 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.658728 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.659598 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.659884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.660196 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] PATH_INFO: `/v3/projects/05bc9944cb73472189fb945f0b717d0e/users/afd5e7a488e049ad8eff7c052e3f38be/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.675460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bc9944cb73472189fb945f0b717d0e, user_id=afd5e7a488e049ad8eff7c052e3f38be, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.678145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.691144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1357/2705] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:49 2022] PUT /identity/v3/projects/05bc9944cb73472189fb945f0b717d0e/users/afd5e7a488e049ad8eff7c052e3f38be/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:49.695259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.705014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5f7e7-3b8b-4813-b4b5-4b68408d1e17 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.764005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f659a-5f03-4cf6-b439-a745ae7df88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.764687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f659a-5f03-4cf6-b439-a745ae7df88e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.764975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f659a-5f03-4cf6-b439-a745ae7df88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.765256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f659a-5f03-4cf6-b439-a745ae7df88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.765989 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f659a-5f03-4cf6-b439-a745ae7df88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.767578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f659a-5f03-4cf6-b439-a745ae7df88e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.778884 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1349/2706] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:49.782937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.793387 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075bcf6-0f78-45bb-a9b9-cf2504e56467 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:49.798350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:49.799269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.799555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.799834 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] PATH_INFO: `/v3/projects/05bc9944cb73472189fb945f0b717d0e/users/afd5e7a488e049ad8eff7c052e3f38be/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.802146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bc9944cb73472189fb945f0b717d0e, user_id=afd5e7a488e049ad8eff7c052e3f38be, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:49.804812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:49.815243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1358/2707] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:49 2022] PUT /identity/v3/projects/05bc9944cb73472189fb945f0b717d0e/users/afd5e7a488e049ad8eff7c052e3f38be/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:49.826210 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:49.826496 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:49.826778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:49.853311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] MFA Rules not processed for user `afd5e7a488e049ad8eff7c052e3f38be`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:49.854526 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:49.924707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1350/2708] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:49.937485 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:49.939380 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:49.998892 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496ba84-14fa-45fa-8f05-75e5c745ad8b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:50.002607 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d3c9d-04ce-40cd-bb03-4fe7a65add44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:50.003246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3c9d-04ce-40cd-bb03-4fe7a65add44 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:50.003532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3c9d-04ce-40cd-bb03-4fe7a65add44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:50.004140 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d3c9d-04ce-40cd-bb03-4fe7a65add44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:50.045244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:50.062709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d3c9d-04ce-40cd-bb03-4fe7a65add44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:50.064316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d3c9d-04ce-40cd-bb03-4fe7a65add44 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:50.074096 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1359/2709] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:55.740014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:55.797603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:55.801855 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437dd32-7c91-4b86-8c4f-e5cf1df5f3a1 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:55.807056 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:55.807941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:55.808248 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:55.809117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] PATH_INFO: `/v3/users/cb1ca115db544d6e9c80fa1aa55f675d` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:55.810296 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1ca115db544d6e9c80fa1aa55f675d)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:55.812230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:55.855819 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1ca115db544d6e9c80fa1aa55f675d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:55.867674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1ca115db544d6e9c80fa1aa55f675d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:55.868393 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1ca115db544d6e9c80fa1aa55f675d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:55.875948 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1ca115db544d6e9c80fa1aa55f675d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:55.883543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1ca115db544d6e9c80fa1aa55f675d'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:55.889300 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1351/2710] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:55 2022] DELETE /identity/v3/users/cb1ca115db544d6e9c80fa1aa55f675d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:55.893649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:55.894146 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:55.894277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:55.910501 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:55.911676 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:55.977263 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1360/2711] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:55.987376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:55.988799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:56.050167 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062e7fa-e4d0-4c6f-b86b-e54b641ce944 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:56.053828 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:56.054476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:56.054760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:56.055037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:56.065671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:56.067132 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:56.076977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1352/2712] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:56.347599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:56.349383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:56.365929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e653e65-b5e7-43d6-afee-0a18bac66b01 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:56.373042 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:56.373971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:56.374280 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:56.374433 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] PATH_INFO: `/v3/projects/e0f3ebaf5e3e4955b9480a55e21db5ad` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:56.375674 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f3ebaf5e3e4955b9480a55e21db5ad)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:56.377748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:56.425849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f3ebaf5e3e4955b9480a55e21db5ad', 'request_id': 'req-6336ce0a-1e34-40da-8d69-029bf5246304'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.432291 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f3ebaf5e3e4955b9480a55e21db5ad', 'request_id': 'req-6336ce0a-1e34-40da-8d69-029bf5246304'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.440295 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f3ebaf5e3e4955b9480a55e21db5ad', 'request_id': 'req-6336ce0a-1e34-40da-8d69-029bf5246304'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.451827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] The token cache is being invalidate because project e0f3ebaf5e3e4955b9480a55e21db5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:56.452147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.452780 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.454394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1361/2713] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:56 2022] DELETE /identity/v3/projects/e0f3ebaf5e3e4955b9480a55e21db5ad => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:56.458592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:56.469010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481ca80-42c2-48d0-a9fd-ab38eb629413 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:56.525479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:56.526334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:56.526543 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:56.526818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] PATH_INFO: `/v3/users/afd5e7a488e049ad8eff7c052e3f38be` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:56.528669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd5e7a488e049ad8eff7c052e3f38be)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:56.530607 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:56.552818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:56.576560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd5e7a488e049ad8eff7c052e3f38be'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.587940 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd5e7a488e049ad8eff7c052e3f38be'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.588618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd5e7a488e049ad8eff7c052e3f38be'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.595739 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd5e7a488e049ad8eff7c052e3f38be'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.603154 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-1fec1754-cf41-41e5-8214-aee5b0d98641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd5e7a488e049ad8eff7c052e3f38be'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:56.609038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1353/2714] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:56 2022] DELETE /identity/v3/users/afd5e7a488e049ad8eff7c052e3f38be => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:56.881254 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:56.882787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:56.896225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336ce0a-1e34-40da-8d69-029bf5246304 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:56.954215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:56.955081 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:56.955362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:56.955637 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] PATH_INFO: `/v3/projects/05bc9944cb73472189fb945f0b717d0e` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:56.956854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bc9944cb73472189fb945f0b717d0e)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:56.958751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:56.964792 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:57.005082 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bc9944cb73472189fb945f0b717d0e', 'request_id': 'req-992c5f2c-bdc0-4402-9a08-84047760ce0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.010970 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bc9944cb73472189fb945f0b717d0e', 'request_id': 'req-992c5f2c-bdc0-4402-9a08-84047760ce0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.017919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bc9944cb73472189fb945f0b717d0e', 'request_id': 'req-992c5f2c-bdc0-4402-9a08-84047760ce0e'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.028492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] The token cache is being invalidate because project 05bc9944cb73472189fb945f0b717d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:57.028787 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.029535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-992c5f2c-bdc0-4402-9a08-84047760ce0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.031078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1362/2715] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:56 2022] DELETE /identity/v3/projects/05bc9944cb73472189fb945f0b717d0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:57.036077 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.036556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.036665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.055237 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:57.056522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.115502 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1354/2716] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:57.123595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.123884 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.124206 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.142100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:57.143304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.151160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1363/2717] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:57.155688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.165244 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cb69a-005f-4f1d-bdd8-9cc0a7db734e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.170400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.171036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.171316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.171606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.172361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:57.172665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.174282 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.185531 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1355/2718] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:57.189741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.199002 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90560-1a5b-4cbb-acc7-8b9c9e30376b None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.203745 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.204450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.205139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.205139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.205687 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.207670 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.235135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1364/2719] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:57 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:06:57.239024 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.249270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1eb5b-f3b1-489c-aead-9c70877baa1f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.314605 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.315297 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.315585 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.315869 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.316591 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.318528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.339840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1356/2720] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:57 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:57.344164 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.355420 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6303009-78f5-49ed-8081-d9716de22759 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.360722 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.361386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.361696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.361977 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.362731 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.364355 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.369693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.371485 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.378259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1365/2721] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:06:57.379236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.383545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c582e4-c86b-4796-95db-0c723a7dba1c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.388841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.389133 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980510-4ac3-4adb-8632-60616f5d4ca1 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.389687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.389970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.390252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] PATH_INFO: `/v3/users/f2702fc090094e99b3ac6ddbba5188ff` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.391427 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2702fc090094e99b3ac6ddbba5188ff)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.393380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.394393 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.395025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.395306 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.395580 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.396323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.397878 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.404800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:57.408818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1366/2722] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:57.412788 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.422668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4cd1d-daf4-49d4-b678-56e0ec6b4359 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.428666 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd34bea-e4f8-45bc-ab72-b8eaff5a20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.429937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd34bea-e4f8-45bc-ab72-b8eaff5a20de admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.430370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd34bea-e4f8-45bc-ab72-b8eaff5a20de admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.430665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd34bea-e4f8-45bc-ab72-b8eaff5a20de admin admin] PATH_INFO: `/v3/projects/c8158e0b793e4ab39eb46f57cd27fda3/users/9d071700ef004aa88715e0efa8915d6f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.442001 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2702fc090094e99b3ac6ddbba5188ff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.445718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd34bea-e4f8-45bc-ab72-b8eaff5a20de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8158e0b793e4ab39eb46f57cd27fda3, user_id=9d071700ef004aa88715e0efa8915d6f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.448476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd34bea-e4f8-45bc-ab72-b8eaff5a20de admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.454853 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2702fc090094e99b3ac6ddbba5188ff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.455644 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2702fc090094e99b3ac6ddbba5188ff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.462694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2702fc090094e99b3ac6ddbba5188ff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.462953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1367/2723] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:57 2022] PUT /identity/v3/projects/c8158e0b793e4ab39eb46f57cd27fda3/users/9d071700ef004aa88715e0efa8915d6f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:57.468627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.468925 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.469202 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.471811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-457883e2-1c58-44e6-b243-4dc37d1dea99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2702fc090094e99b3ac6ddbba5188ff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:57.478878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1357/2724] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:57 2022] DELETE /identity/v3/users/f2702fc090094e99b3ac6ddbba5188ff => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:57.482885 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.483174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.483453 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.485602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:57.486819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.501647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:57.502619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.547823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1368/2725] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:57.557509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.558913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.562756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1358/2726] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:57.571620 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:57.572929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:57.582660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:57.620741 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b992d-9dc9-4216-8d4f-7ab531a56afb None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.625195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.625930 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.626267 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.626550 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.629332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0b0c-85d0-4aa2-9b28-a6b8652a2859 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:57.632996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:57.633636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:57.633920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:57.634198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:57.635859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.637968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.644236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:57.645664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:57.647251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1369/2727] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:06:57.655332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1359/2728] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:06:58.015356 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:58.019779 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:58.053814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31861edd-59c2-4a23-a5cf-4a51fcc01e7c service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:58.060188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:58.061314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.061776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.062338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] PATH_INFO: `/v3/projects/534cd8c6aeaf4146901b1023ef8e7747` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.063733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=534cd8c6aeaf4146901b1023ef8e7747)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:58.065850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:58.125686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534cd8c6aeaf4146901b1023ef8e7747', 'request_id': 'req-5924da56-d890-4d07-ae5b-7117870e4fc3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.132945 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534cd8c6aeaf4146901b1023ef8e7747', 'request_id': 'req-5924da56-d890-4d07-ae5b-7117870e4fc3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.142372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534cd8c6aeaf4146901b1023ef8e7747', 'request_id': 'req-5924da56-d890-4d07-ae5b-7117870e4fc3'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.156552 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] The token cache is being invalidate because project 534cd8c6aeaf4146901b1023ef8e7747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:58.156932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.158111 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-5924da56-d890-4d07-ae5b-7117870e4fc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.160345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1370/2729] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:58 2022] DELETE /identity/v3/projects/534cd8c6aeaf4146901b1023ef8e7747 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:58.164999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:58.175639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56ee48-b2db-40e0-9cac-b4256b81b58a service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:58.205707 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:58.237998 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:58.239395 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.239754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.240180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] PATH_INFO: `/v3/users/e768a704cf2b481694bbc3b8c2630dff` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.241493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e768a704cf2b481694bbc3b8c2630dff)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:58.243678 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:58.292554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e768a704cf2b481694bbc3b8c2630dff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.305630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e768a704cf2b481694bbc3b8c2630dff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.306332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e768a704cf2b481694bbc3b8c2630dff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.314494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e768a704cf2b481694bbc3b8c2630dff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.323010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e768a704cf2b481694bbc3b8c2630dff'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.331310 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1360/2730] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:06:58 2022] DELETE /identity/v3/users/e768a704cf2b481694bbc3b8c2630dff => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:58.375964 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.376274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.376559 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.405796 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] MFA Rules not processed for user `9d071700ef004aa88715e0efa8915d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:58.407137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:58.499255 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1371/2731] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:58.512558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:58.524369 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:58.599131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcec29-d359-4128-9ecf-4dc181a08045 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:58.603688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ec757-57cd-4e65-a971-6fded680a452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:58.604388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ec757-57cd-4e65-a971-6fded680a452 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.605190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ec757-57cd-4e65-a971-6fded680a452 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.605190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ec757-57cd-4e65-a971-6fded680a452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.614755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ec757-57cd-4e65-a971-6fded680a452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:58.616252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ec757-57cd-4e65-a971-6fded680a452 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:58.627921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1361/2732] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:06:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:06:58.673354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:58.674822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:58.743681 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:58.772372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80ed71-d710-4b74-b353-5f256f72c667 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:58.777435 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:58.778840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.779118 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.779389 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] PATH_INFO: `/v3/projects/b7308342d8d14738b51723224b8824f0` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.780650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7308342d8d14738b51723224b8824f0)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:58.782589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:58.833896 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7308342d8d14738b51723224b8824f0', 'request_id': 'req-8fdae1e7-318f-4c43-af6d-29eac2fa1052'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.841087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7308342d8d14738b51723224b8824f0', 'request_id': 'req-8fdae1e7-318f-4c43-af6d-29eac2fa1052'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.849098 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7308342d8d14738b51723224b8824f0', 'request_id': 'req-8fdae1e7-318f-4c43-af6d-29eac2fa1052'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.860419 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] The token cache is being invalidate because project b7308342d8d14738b51723224b8824f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:06:58.860712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.861353 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-8fdae1e7-318f-4c43-af6d-29eac2fa1052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:06:58.863229 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1372/2733] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:06:58 2022] DELETE /identity/v3/projects/b7308342d8d14738b51723224b8824f0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:58.868459 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.868847 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.869192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.895738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:58.895738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:58.952528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:58.968150 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1362/2734] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:06:58.976188 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:58.976531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:58.976894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:58.996303 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:58.997587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:59.006154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1373/2735] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:59.010419 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.020667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c0126-e08d-484f-96ac-ece0f07c090f None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.025251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.025897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.026181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.026466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.027186 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:06:59.027551 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.029835 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.041778 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1363/2736] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:06:59.045908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.055881 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff925e-5a10-4283-98f2-573c891d7c45 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.060822 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.061473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.061754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.062476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.063180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.065090 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.090814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1374/2737] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:59.094994 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.105704 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb4428-7c93-4516-95a1-e9133cdb84f0 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.165553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.166205 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.166486 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.166762 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.167454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.169401 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.189332 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1364/2738] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:59.193407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.204258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eaafb-a2da-4e40-8650-99bcb870db72 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.208856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.209509 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.209795 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.210073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.210831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.212448 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.222628 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1375/2739] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:59.226304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.236243 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3019587-9bae-4c4c-98bc-bc9d42277ab2 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.241104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1e7dd-2533-47ce-a608-74c535d66f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.241752 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e7dd-2533-47ce-a608-74c535d66f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.242038 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e7dd-2533-47ce-a608-74c535d66f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.242573 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1e7dd-2533-47ce-a608-74c535d66f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.243294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e7dd-2533-47ce-a608-74c535d66f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.244907 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1e7dd-2533-47ce-a608-74c535d66f6b admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.255188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1365/2740] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:59.259197 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.269570 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30eb05-99ed-4a5f-8504-ea78c483d389 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.274173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.275043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.275324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.275602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] PATH_INFO: `/v3/projects/46280034c88a4e51bfdd2ce6e7938856/users/5e60071abae447c5918af80db159856f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.290024 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=46280034c88a4e51bfdd2ce6e7938856, user_id=5e60071abae447c5918af80db159856f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.292714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.304869 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1376/2741] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:59 2022] PUT /identity/v3/projects/46280034c88a4e51bfdd2ce6e7938856/users/5e60071abae447c5918af80db159856f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:06:59.315483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.315784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.316097 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.343687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] MFA Rules not processed for user `5e60071abae447c5918af80db159856f`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:59.344879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:59.408052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1366/2742] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:59.412449 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.471996 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0583a2-426c-4a6a-bfd3-d0e66747f4db admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.476611 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.477252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.477535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.477812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.478500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.480427 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.484835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:59.506500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1377/2743] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:59.510512 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.521328 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f651699-2289-41f2-8a79-5a265d77c85c None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.565894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:06:59.578507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.579230 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.579513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.579791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.580497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.582556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.601906 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1367/2744] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:59.606249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.616478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05793c4-3822-4c0a-845d-5b38723b0c72 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.621978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.622624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.622910 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.623189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.623942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.625582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.638139 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1378/2745] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:59.639800 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.649673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9822e-12cb-44f9-9d80-f429394a1e90 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.654318 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6fd6b-810d-4d23-94d1-1c0e7ad19b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.654964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6fd6b-810d-4d23-94d1-1c0e7ad19b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.655251 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6fd6b-810d-4d23-94d1-1c0e7ad19b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.655528 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6fd6b-810d-4d23-94d1-1c0e7ad19b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.656287 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6fd6b-810d-4d23-94d1-1c0e7ad19b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.657860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6fd6b-810d-4d23-94d1-1c0e7ad19b0f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.667705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1368/2746] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:06:59.671954 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.681775 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a8f96-6414-48c7-bab1-2e6bd0bc97da admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.686994 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.687859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.688244 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.688525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] PATH_INFO: `/v3/projects/dbe8e552f4d2457b8cd7f88fd84b58bb/users/644038034dcf4fb797390a0a562ea366/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.702620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe8e552f4d2457b8cd7f88fd84b58bb, user_id=644038034dcf4fb797390a0a562ea366, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.705278 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.717908 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1379/2747] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:06:59 2022] PUT /identity/v3/projects/dbe8e552f4d2457b8cd7f88fd84b58bb/users/644038034dcf4fb797390a0a562ea366/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:06:59.729151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.729465 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.729743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.757263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] MFA Rules not processed for user `644038034dcf4fb797390a0a562ea366`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:06:59.758482 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:06:59.820748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1369/2748] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:06:59.825242 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.885999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad577f-4b05-46f0-997f-f6d08cdf05a5 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.890574 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0690423-8f66-422d-aa1d-c770842344c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.891264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690423-8f66-422d-aa1d-c770842344c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.891545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690423-8f66-422d-aa1d-c770842344c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.891820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0690423-8f66-422d-aa1d-c770842344c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.892547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0690423-8f66-422d-aa1d-c770842344c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.894447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0690423-8f66-422d-aa1d-c770842344c1 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:06:59.919325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1380/2749] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:06:59.923342 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:06:59.934570 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b8b63-1dca-4ff6-9235-b83fc34e3e75 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:06:59.990951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:06:59.991618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:06:59.991898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:06:59.992473 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:06:59.993168 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:06:59.995055 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:00.002743 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.003064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.003347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.018782 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1370/2750] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:06:59 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:00.019784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:00.022008 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] MFA Rules not processed for user `9d071700ef004aa88715e0efa8915d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:00.023270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:00.029943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24679a0a-4cdf-4cc4-84e7-a79d3fd8bbb7 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:00.035344 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:00.035995 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.036305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.036652 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.037388 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:00.039049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:00.049942 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1371/2751] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:00.053943 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:00.063568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995d4e-9d23-451c-a207-0f8bb137102f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:00.068444 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:00.069448 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.069736 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.070014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] PATH_INFO: `/v3/projects/730c816d282744799028e9d5daea8b5e/users/aacf124db65849bfa6067b7188e7f57b/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.081159 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1381/2752] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:07:00.093996 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=730c816d282744799028e9d5daea8b5e, user_id=aacf124db65849bfa6067b7188e7f57b, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:00.097246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:00.124173 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1372/2753] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:00 2022] PUT /identity/v3/projects/730c816d282744799028e9d5daea8b5e/users/aacf124db65849bfa6067b7188e7f57b/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:07:00.126357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:00.144385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740f5a-97a7-4331-ac34-33af5e3eab48 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:00.199415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:00.218864 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd4400-d59b-493a-88c1-aa6654cd0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:00.219549 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd4400-d59b-493a-88c1-aa6654cd0eae admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.219836 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd4400-d59b-493a-88c1-aa6654cd0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.220161 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd4400-d59b-493a-88c1-aa6654cd0eae admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.220899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd4400-d59b-493a-88c1-aa6654cd0eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:00.222536 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd4400-d59b-493a-88c1-aa6654cd0eae admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:00.234576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1382/2754] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:00.238694 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:00.249875 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069fe0e-9e02-458b-b69d-263085e3b71c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:00.254726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:00.255618 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.255904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.256867 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] PATH_INFO: `/v3/projects/730c816d282744799028e9d5daea8b5e/users/aacf124db65849bfa6067b7188e7f57b/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.258362 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=730c816d282744799028e9d5daea8b5e, user_id=aacf124db65849bfa6067b7188e7f57b, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:00.261058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:00.267716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:00.273951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1373/2755] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:00 2022] PUT /identity/v3/projects/730c816d282744799028e9d5daea8b5e/users/aacf124db65849bfa6067b7188e7f57b/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:00.284749 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.285025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.285314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.317003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] MFA Rules not processed for user `aacf124db65849bfa6067b7188e7f57b`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:00.318352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:00.393466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1383/2756] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:00.404944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:00.406745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:00.468634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a1077-5498-4a52-ab7a-375befbacc4c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:00.474013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:00.474951 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:00.475367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:00.475777 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:00.487959 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:00.490665 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:00.503840 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1374/2757] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:01.024052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:01.025431 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:01.037709 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caab310-5f4c-4e6c-9136-a43431dd89b1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:01.041399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:01.042067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:01.042374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:01.042653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:01.103213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:01.104734 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:01.115408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1384/2758] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:05.090842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:05.099576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3abc-1526-4e40-8c7b-b8e2ef864a15 service cinder] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:05.103199 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7414d-f2a4-4a69-bf08-0810a4e7d229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:05.103829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7414d-f2a4-4a69-bf08-0810a4e7d229 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:05.104151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7414d-f2a4-4a69-bf08-0810a4e7d229 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:05.104425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7414d-f2a4-4a69-bf08-0810a4e7d229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:05.159999 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7414d-f2a4-4a69-bf08-0810a4e7d229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:05.161445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7414d-f2a4-4a69-bf08-0810a4e7d229 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:05.170263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1375/2759] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:07.218207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:07.280370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a2d1-f352-4451-abd0-5c2b33402e0b service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:07.284948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:07.285844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:07.286127 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:07.286407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] PATH_INFO: `/v3/users/5e60071abae447c5918af80db159856f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:07.287589 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e60071abae447c5918af80db159856f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:07.289543 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:07.291807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:07.335865 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e60071abae447c5918af80db159856f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.348354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e60071abae447c5918af80db159856f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.355410 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e60071abae447c5918af80db159856f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.362167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e60071abae447c5918af80db159856f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.362804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e60071abae447c5918af80db159856f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.368903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1385/2760] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:07:07 2022] DELETE /identity/v3/users/5e60071abae447c5918af80db159856f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:07.374048 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:07.374523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:07.374647 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:07.392087 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:07.393278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:07.451730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1376/2761] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:07.461270 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:07.462648 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:07.523999 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea704a3-6d3c-4290-8727-0d044a405122 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:07.527877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:07.528545 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:07.528828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:07.529103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:07.538049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:07.539463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:07.548826 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1386/2762] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:07.886409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:07.887939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:07.902222 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa088ea-f20c-4b84-98d4-6d951171d0dc None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:07.906760 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:07.907611 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:07.907889 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:07.913071 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] PATH_INFO: `/v3/projects/46280034c88a4e51bfdd2ce6e7938856` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:07.914676 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] RBAC: Authorizing `identity:delete_project(project_id=46280034c88a4e51bfdd2ce6e7938856)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:07.916642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:07.956733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:07.967544 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46280034c88a4e51bfdd2ce6e7938856', 'request_id': 'req-c15b7dfc-3b95-4b7b-851a-76c1335a205f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.973603 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46280034c88a4e51bfdd2ce6e7938856', 'request_id': 'req-c15b7dfc-3b95-4b7b-851a-76c1335a205f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.980966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46280034c88a4e51bfdd2ce6e7938856', 'request_id': 'req-c15b7dfc-3b95-4b7b-851a-76c1335a205f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.991558 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] The token cache is being invalidate because project 46280034c88a4e51bfdd2ce6e7938856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:07:07.991844 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.992784 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:07.994378 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1377/2763] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:07:07 2022] DELETE /identity/v3/projects/46280034c88a4e51bfdd2ce6e7938856 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:07.998944 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:08.008600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f35653-2fbb-41ed-b707-0d255209bece service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:08.065238 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:08.066103 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:08.066386 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:08.066663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] PATH_INFO: `/v3/users/644038034dcf4fb797390a0a562ea366` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:08.067854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] RBAC: Authorizing `identity:delete_user(user_id=644038034dcf4fb797390a0a562ea366)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:08.069782 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:08.097966 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:08.120828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644038034dcf4fb797390a0a562ea366'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.133070 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644038034dcf4fb797390a0a562ea366'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.141866 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644038034dcf4fb797390a0a562ea366'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.148868 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644038034dcf4fb797390a0a562ea366'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.149500 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644038034dcf4fb797390a0a562ea366'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.155786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1387/2764] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:07:07 2022] DELETE /identity/v3/users/644038034dcf4fb797390a0a562ea366 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:08.417326 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:08.419321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:08.433993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b7dfc-3b95-4b7b-851a-76c1335a205f admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:08.498965 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:08.499832 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:08.500143 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:08.500417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] PATH_INFO: `/v3/projects/dbe8e552f4d2457b8cd7f88fd84b58bb` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:08.501584 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe8e552f4d2457b8cd7f88fd84b58bb)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:08.503479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:08.552098 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe8e552f4d2457b8cd7f88fd84b58bb', 'request_id': 'req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.558925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe8e552f4d2457b8cd7f88fd84b58bb', 'request_id': 'req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.566619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe8e552f4d2457b8cd7f88fd84b58bb', 'request_id': 'req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.578389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] The token cache is being invalidate because project dbe8e552f4d2457b8cd7f88fd84b58bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:07:08.578681 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.579316 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.583634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1378/2765] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:07:08 2022] DELETE /identity/v3/projects/dbe8e552f4d2457b8cd7f88fd84b58bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:08.585065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:08.586600 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:08.601297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572fa44-e410-468c-834b-9b09b802526b admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:08.665665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:08.667331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:08.667939 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:08.668299 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] PATH_INFO: `/v3/users/aacf124db65849bfa6067b7188e7f57b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:08.669534 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacf124db65849bfa6067b7188e7f57b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:08.671444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:08.725712 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacf124db65849bfa6067b7188e7f57b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.738345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacf124db65849bfa6067b7188e7f57b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.746153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacf124db65849bfa6067b7188e7f57b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.753302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacf124db65849bfa6067b7188e7f57b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.753981 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e7287049-b3b2-475b-b027-69b4b96b8a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacf124db65849bfa6067b7188e7f57b'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:08.760184 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1388/2766] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:07:08 2022] DELETE /identity/v3/users/aacf124db65849bfa6067b7188e7f57b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:07:09.081355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.082816 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:09.096561 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed1abc-750f-44ca-8f76-0f9f551c3a07 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.146534 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:09.158059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.158924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.159207 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.159484 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] PATH_INFO: `/v3/projects/730c816d282744799028e9d5daea8b5e` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.160646 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=730c816d282744799028e9d5daea8b5e)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.162563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.208871 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730c816d282744799028e9d5daea8b5e', 'request_id': 'req-f346df5b-1155-4117-b177-e8eb366cdc18'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:09.214718 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730c816d282744799028e9d5daea8b5e', 'request_id': 'req-f346df5b-1155-4117-b177-e8eb366cdc18'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:09.221826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730c816d282744799028e9d5daea8b5e', 'request_id': 'req-f346df5b-1155-4117-b177-e8eb366cdc18'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:09.232298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] The token cache is being invalidate because project 730c816d282744799028e9d5daea8b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:07:09.232578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:09.233188 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f346df5b-1155-4117-b177-e8eb366cdc18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:09.234692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1379/2767] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:07:09 2022] DELETE /identity/v3/projects/730c816d282744799028e9d5daea8b5e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:09.241715 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.242009 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.242285 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.261337 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:09.262531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:09.278675 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:09.322354 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1389/2768] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:09.331719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.332030 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.332307 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.349921 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:09.351107 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:09.359426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1380/2769] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:09.363464 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.373846 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8ae3f-1edc-48a6-9844-1884973068a4 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.378297 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.378937 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.379216 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.379488 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.380237 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:07:09.380541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.382121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.393224 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1390/2770] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:07:09.397271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.406464 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3658e9-b393-40b0-95aa-34bd0f185bb6 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.411009 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.411641 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.411920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.412225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.412895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.414763 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.440497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1381/2771] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:09.444856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.454725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d973f-859c-4094-826c-77551e6dc18c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.509863 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.510508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.510794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.511064 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.511733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.513672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.532669 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1391/2772] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:09.536671 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.547740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdc35a-83dd-4af1-b7d5-a4100329d84d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.552298 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.552941 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.553218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.553490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.554198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.555873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.566997 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1382/2773] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:09.570850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.580685 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bc177-8e56-4c50-a00f-f29f5c9c5d2c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.585257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5f174-6909-4fc5-9eeb-783f5f72d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.585901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f174-6909-4fc5-9eeb-783f5f72d7de admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.586187 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f174-6909-4fc5-9eeb-783f5f72d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.586469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f174-6909-4fc5-9eeb-783f5f72d7de admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.587191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5f174-6909-4fc5-9eeb-783f5f72d7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.588798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5f174-6909-4fc5-9eeb-783f5f72d7de admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.598935 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1392/2774] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:09.602722 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.613006 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577447a-e98c-4af4-aced-f6e49f5e0f6c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.617836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.618698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.618977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.619252 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] PATH_INFO: `/v3/projects/1c7088ee5dd2496cae413b45fe7f5259/users/08e2743e0aec4c99a54ef860c20aa4ff/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.633400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7088ee5dd2496cae413b45fe7f5259, user_id=08e2743e0aec4c99a54ef860c20aa4ff, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.636052 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.648850 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1383/2775] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:09 2022] PUT /identity/v3/projects/1c7088ee5dd2496cae413b45fe7f5259/users/08e2743e0aec4c99a54ef860c20aa4ff/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:09.660560 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026886-92b9-4c82-b620-3dff252891da None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.660854 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026886-92b9-4c82-b620-3dff252891da None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.661136 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59026886-92b9-4c82-b620-3dff252891da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.687563 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-59026886-92b9-4c82-b620-3dff252891da None None] MFA Rules not processed for user `08e2743e0aec4c99a54ef860c20aa4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:09.688808 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-59026886-92b9-4c82-b620-3dff252891da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:09.752519 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1393/2776] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:09.756975 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.816865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a32f4-b8e8-4862-888d-5c61359ee0df admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.821480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.822126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.822409 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.822685 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.823376 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.825325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.849802 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1384/2777] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:09.853885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026886-92b9-4c82-b620-3dff252891da None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.865162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59026886-92b9-4c82-b620-3dff252891da None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.877432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:09.922360 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.923023 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.923305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.923578 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.924304 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.926246 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.947071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1394/2778] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:07:09 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:07:09.951135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.957682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:09.961791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456590-6343-4ad9-b540-7cfde2e0cbca admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:09.968441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:09.969103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:09.969548 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:09.970059 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:09.970904 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:09.972533 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:09.983680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1385/2779] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:09.987480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:09.997698 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a03c90-17f5-4ae9-8466-cf16fd352d8e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.002326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5507e-3277-4d02-8e0a-e33fd92dd3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.002978 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5507e-3277-4d02-8e0a-e33fd92dd3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.003265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5507e-3277-4d02-8e0a-e33fd92dd3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.003547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5507e-3277-4d02-8e0a-e33fd92dd3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.004325 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5507e-3277-4d02-8e0a-e33fd92dd3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.005906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5507e-3277-4d02-8e0a-e33fd92dd3d8 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.016225 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1395/2780] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:10.020126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.030501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc175-af47-47bb-933f-4fcf7bb0747e admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.035121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.036019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.036305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.036987 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] PATH_INFO: `/v3/projects/b9af93a1bc324125a7f80a1c11ac107f/users/ecb4cf993d2044949e1a6ae62be3e7db/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.051389 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9af93a1bc324125a7f80a1c11ac107f, user_id=ecb4cf993d2044949e1a6ae62be3e7db, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.054066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.068275 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1386/2781] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:10 2022] PUT /identity/v3/projects/b9af93a1bc324125a7f80a1c11ac107f/users/ecb4cf993d2044949e1a6ae62be3e7db/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:10.079110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23e85-6038-4e79-828f-838af09458e2 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.079405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23e85-6038-4e79-828f-838af09458e2 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.079718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add23e85-6038-4e79-828f-838af09458e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.108121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-add23e85-6038-4e79-828f-838af09458e2 None None] MFA Rules not processed for user `ecb4cf993d2044949e1a6ae62be3e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:10.109347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-add23e85-6038-4e79-828f-838af09458e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:10.177832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1396/2782] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:10.182236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.242051 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1a7fb-7166-492c-8c0f-650eb90a45fb admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.246879 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.247523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.247804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.248100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.248770 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.250642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.275367 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1387/2783] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:07:10 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:10.280160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add23e85-6038-4e79-828f-838af09458e2 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.290793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add23e85-6038-4e79-828f-838af09458e2 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.345842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.346450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.346738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.347018 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.347697 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.349641 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.372498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1397/2784] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:07:10 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:07:10.375740 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.385833 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb052daa-9e47-49ca-9023-7182c78e4b54 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.390977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.391619 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.391898 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.392235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.392983 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.394555 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.404841 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1388/2785] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:10.408710 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.418535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f09d0-a503-4ffa-ae03-793d6f03af80 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.423169 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.424078 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.424367 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.424647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] PATH_INFO: `/v3/projects/b999ef8ddf2d4d97ad4e58d4db2a3cdd/users/c41477de24054c16bb266cf615a23f12/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.436860 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:10.440243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b999ef8ddf2d4d97ad4e58d4db2a3cdd, user_id=c41477de24054c16bb266cf615a23f12, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.443758 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.457663 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1398/2786] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:10 2022] PUT /identity/v3/projects/b999ef8ddf2d4d97ad4e58d4db2a3cdd/users/c41477de24054c16bb266cf615a23f12/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:10.461571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.473507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0013f6-cc16-42fd-81ed-26c4549a5113 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.532789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a293e-f6ad-4b30-b4ea-6807522c7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.533458 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a293e-f6ad-4b30-b4ea-6807522c7d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.533745 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a293e-f6ad-4b30-b4ea-6807522c7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.534026 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a293e-f6ad-4b30-b4ea-6807522c7d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.534754 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a293e-f6ad-4b30-b4ea-6807522c7d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.536406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a293e-f6ad-4b30-b4ea-6807522c7d86 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.549655 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1389/2787] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:07:10.550812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.562525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1921de1-1c6f-47e3-ac1d-bd3856fb2b9c admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.567265 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.568191 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.568480 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.568760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] PATH_INFO: `/v3/projects/b999ef8ddf2d4d97ad4e58d4db2a3cdd/users/c41477de24054c16bb266cf615a23f12/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.570725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b999ef8ddf2d4d97ad4e58d4db2a3cdd, user_id=c41477de24054c16bb266cf615a23f12, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.573430 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.583662 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1399/2788] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:10 2022] PUT /identity/v3/projects/b999ef8ddf2d4d97ad4e58d4db2a3cdd/users/c41477de24054c16bb266cf615a23f12/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:07:10.595060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.595353 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.595639 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.622327 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] MFA Rules not processed for user `c41477de24054c16bb266cf615a23f12`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:10.623474 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:10.651396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:10.691634 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1390/2789] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:10.702882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.704733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:10.761437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59729c3d-6848-4488-bd24-de10341258dc admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.765960 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.766615 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.766932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.767219 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.776469 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.777929 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.787899 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1400/2790] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:10.825789 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:10.827187 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:10.839067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0354c-952b-48fb-9f7c-2355d2d442ef None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:10.843586 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d30309-ba6c-444f-9b47-af8f55c9b328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:10.844266 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30309-ba6c-444f-9b47-af8f55c9b328 service cinder] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:10.844556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30309-ba6c-444f-9b47-af8f55c9b328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:10.844838 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d30309-ba6c-444f-9b47-af8f55c9b328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:10.902571 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d30309-ba6c-444f-9b47-af8f55c9b328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:10.904579 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d30309-ba6c-444f-9b47-af8f55c9b328 service cinder] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:10.913382 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1391/2791] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:13.755478 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:13.817573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd41607-0918-4646-8bc5-2b1b06dbf035 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:13.822117 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:13.822974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:13.823252 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:13.823525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] PATH_INFO: `/v3/users/08e2743e0aec4c99a54ef860c20aa4ff` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:13.824733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e2743e0aec4c99a54ef860c20aa4ff)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:13.826725 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:13.872827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e2743e0aec4c99a54ef860c20aa4ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:13.885261 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e2743e0aec4c99a54ef860c20aa4ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:13.893770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e2743e0aec4c99a54ef860c20aa4ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:13.902445 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e2743e0aec4c99a54ef860c20aa4ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:13.903177 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e2743e0aec4c99a54ef860c20aa4ff'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:13.905347 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:13.910145 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1401/2792] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:07:13 2022] DELETE /identity/v3/users/08e2743e0aec4c99a54ef860c20aa4ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:13.915489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:13.916068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:13.916219 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:13.935441 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:13.936830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:14.001969 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1392/2793] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:14.011968 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:14.013528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:14.072217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d778-633d-485b-b7b4-c548f72a67a2 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:14.076473 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:14.077154 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:14.077437 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:14.077714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:14.092859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:14.094328 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:14.105137 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1402/2794] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:14.384865 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:14.386578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:14.409954 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1f3e-dc4e-46cb-8558-28b094a952a6 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:14.415174 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:14.416103 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:14.417254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:14.417254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] PATH_INFO: `/v3/projects/1c7088ee5dd2496cae413b45fe7f5259` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:14.417897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7088ee5dd2496cae413b45fe7f5259)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:14.419851 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:14.470631 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7088ee5dd2496cae413b45fe7f5259', 'request_id': 'req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.478873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7088ee5dd2496cae413b45fe7f5259', 'request_id': 'req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.484036 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:14.488992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7088ee5dd2496cae413b45fe7f5259', 'request_id': 'req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.502125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] The token cache is being invalidate because project 1c7088ee5dd2496cae413b45fe7f5259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:07:14.502430 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.503130 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.504728 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1393/2795] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:07:14 2022] DELETE /identity/v3/projects/1c7088ee5dd2496cae413b45fe7f5259 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:14.508711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:14.518408 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26290fea-6f1e-419f-ae7b-b1905874e861 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:14.560329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:14.561956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:14.578720 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:14.579807 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:14.580213 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:14.580587 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] PATH_INFO: `/v3/users/ecb4cf993d2044949e1a6ae62be3e7db` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:14.581833 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb4cf993d2044949e1a6ae62be3e7db)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:14.583790 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:14.632112 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb4cf993d2044949e1a6ae62be3e7db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.633437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e6831-ebaa-4aa2-adf0-0c722f1d5e35 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:14.639692 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:14.640373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:14.640653 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:14.640925 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:14.642703 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:14.644358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb4cf993d2044949e1a6ae62be3e7db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.652110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb4cf993d2044949e1a6ae62be3e7db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.655576 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:14.657179 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:14.659950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb4cf993d2044949e1a6ae62be3e7db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.660785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb4cf993d2044949e1a6ae62be3e7db'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:14.667165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1403/2796] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:07:14 2022] DELETE /identity/v3/users/ecb4cf993d2044949e1a6ae62be3e7db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:14.667304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1394/2797] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:07:14.941565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:14.943401 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:14.974217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:15.015046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db811379-49e3-4695-8984-c7be08858ef7 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:15.019510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:15.020396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.020682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.020958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] PATH_INFO: `/v3/projects/b9af93a1bc324125a7f80a1c11ac107f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.022131 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9af93a1bc324125a7f80a1c11ac107f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:15.024050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:15.069114 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9af93a1bc324125a7f80a1c11ac107f', 'request_id': 'req-ddd09102-1f0c-4280-9569-7e6ba83f753f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.075701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9af93a1bc324125a7f80a1c11ac107f', 'request_id': 'req-ddd09102-1f0c-4280-9569-7e6ba83f753f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.082330 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9af93a1bc324125a7f80a1c11ac107f', 'request_id': 'req-ddd09102-1f0c-4280-9569-7e6ba83f753f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.092757 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] The token cache is being invalidate because project b9af93a1bc324125a7f80a1c11ac107f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:07:15.093048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.093693 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-ddd09102-1f0c-4280-9569-7e6ba83f753f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.095286 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1404/2798] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:07:14 2022] DELETE /identity/v3/projects/b9af93a1bc324125a7f80a1c11ac107f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:15.099293 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:15.101123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:15.114276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9a524-d903-41cd-bfab-fd3e7dd554b0 service placement] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:15.173977 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:15.174929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.175255 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.175697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] PATH_INFO: `/v3/users/c41477de24054c16bb266cf615a23f12` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.176866 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41477de24054c16bb266cf615a23f12)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:15.178918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:15.226908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41477de24054c16bb266cf615a23f12'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.241283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41477de24054c16bb266cf615a23f12'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.241970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41477de24054c16bb266cf615a23f12'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.250534 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41477de24054c16bb266cf615a23f12'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.255050 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:15.259223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41477de24054c16bb266cf615a23f12'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.267724 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1395/2799] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:07:15 2022] DELETE /identity/v3/users/c41477de24054c16bb266cf615a23f12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:15.533902 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581a18f-4724-4d9e-8fc6-ae244a9690f0 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.534199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581a18f-4724-4d9e-8fc6-ae244a9690f0 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.534482 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581a18f-4724-4d9e-8fc6-ae244a9690f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.539872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:15.541535 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:15.555375 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-9581a18f-4724-4d9e-8fc6-ae244a9690f0 None None] MFA Rules not processed for user `9d071700ef004aa88715e0efa8915d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:15.556650 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9581a18f-4724-4d9e-8fc6-ae244a9690f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:15.615054 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760412bb-f530-4443-89eb-1c167b24749c admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:15.616895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1405/2800] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:15.619944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:15.621178 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.621469 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.621774 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] PATH_INFO: `/v3/projects/b999ef8ddf2d4d97ad4e58d4db2a3cdd` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.622974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b999ef8ddf2d4d97ad4e58d4db2a3cdd)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:15.624950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:15.672260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b999ef8ddf2d4d97ad4e58d4db2a3cdd', 'request_id': 'req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.678460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b999ef8ddf2d4d97ad4e58d4db2a3cdd', 'request_id': 'req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.686557 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b999ef8ddf2d4d97ad4e58d4db2a3cdd', 'request_id': 'req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.697291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] The token cache is being invalidate because project b999ef8ddf2d4d97ad4e58d4db2a3cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:07:15.697582 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.698218 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-fc3ec705-1399-41b6-92e2-cb9fcf332d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:07:15.699803 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1396/2801] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:07:15 2022] DELETE /identity/v3/projects/b999ef8ddf2d4d97ad4e58d4db2a3cdd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:07:15.705993 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.706288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.706573 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.725440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:15.726653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:15.778938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:15.790004 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1406/2802] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:15.799144 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.799435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.799709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.819751 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:15.821667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:15.833311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1397/2803] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:15.837511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:15.848740 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf09e71-171f-4e14-9f89-fef49a537972 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:15.853672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:15.854346 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.854730 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.855019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.855754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:07:15.856100 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:15.858339 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:15.871013 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1407/2804] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:07:15.875336 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:15.884775 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c412-82cb-4d40-9427-55ff0cd75ea0 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:15.889470 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:15.890115 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.890404 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.890679 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.891372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:15.893338 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:15.924406 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1398/2805] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:07:15 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:15.925606 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:15.935870 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c211b-011c-43cf-b8c1-9261776982bd admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:15.995438 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:15.996200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:15.996415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:15.996695 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:15.997414 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:15.999326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:16.020768 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1408/2806] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:07:15 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:16.024674 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:16.035614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91e417-0620-49fc-adb0-e9cf7afe3037 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:16.040371 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:16.041031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:16.041317 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:16.041598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:16.042329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:16.044014 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:16.055278 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1399/2807] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:16.059162 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:16.069404 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13633f-e672-46a1-ab00-7f9869acd602 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:16.074388 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32853f38-ecdf-4337-ae3d-708f2be186a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:16.076052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853f38-ecdf-4337-ae3d-708f2be186a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:16.076341 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853f38-ecdf-4337-ae3d-708f2be186a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:16.076623 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32853f38-ecdf-4337-ae3d-708f2be186a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:16.077351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853f38-ecdf-4337-ae3d-708f2be186a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:16.078962 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32853f38-ecdf-4337-ae3d-708f2be186a3 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:16.089487 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1409/2808] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:16.093966 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:16.104826 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2812-1434-4001-9983-e808e8d450f3 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:16.109621 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:16.110507 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:16.110807 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:16.111060 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] PATH_INFO: `/v3/projects/dff115ce08e947c29313f5019cf568fd/users/9f42593700cb41408d258257c652f5b7/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:16.126013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff115ce08e947c29313f5019cf568fd, user_id=9f42593700cb41408d258257c652f5b7, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:16.128721 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:16.146673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1400/2809] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:16 2022] PUT /identity/v3/projects/dff115ce08e947c29313f5019cf568fd/users/9f42593700cb41408d258257c652f5b7/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:07:16.151946 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab0cd-f63d-45c6-84d8-35197d861504 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:16.152277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab0cd-f63d-45c6-84d8-35197d861504 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:16.152558 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ab0cd-f63d-45c6-84d8-35197d861504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:16.173719 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-1c8ab0cd-f63d-45c6-84d8-35197d861504 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:16.175058 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-1c8ab0cd-f63d-45c6-84d8-35197d861504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:16.241599 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1410/2810] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:16.251490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:16.253182 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:16.279956 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:16.313587 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628ff68-9cf9-4e26-bb63-d907479d5108 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:16.317439 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:16.318119 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:16.318403 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:16.318682 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:16.328589 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:16.330102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:16.342304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1401/2811] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:20.781010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:20.781551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:20.781652 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:20.824624 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] MFA Rules not processed for user `9f42593700cb41408d258257c652f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:20.826075 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:20.889266 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:20.901919 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1411/2812] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:20.907015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:20.917547 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197eada-bc7f-4c4e-bb44-44140d73870f service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:20.923713 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:20.924445 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:20.924731 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:20.925004 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:20.925693 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:20.927596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:20.961606 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1402/2813] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:07:20 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:20.962837 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:20.975294 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88d444-4f81-4ad0-a8a1-e9c4d67e3d38 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:21.047317 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:21.049555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:21.049845 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:21.050121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:21.050848 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:21.052823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:21.087591 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1412/2814] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:07:20 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:07:21.089281 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:21.107057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb6941-a915-48f1-a13d-6f94b5e173dc admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:21.117122 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:21.118068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:21.118351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:21.120110 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:21.121088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:21.123315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:21.140346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1403/2815] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:07:21.141505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:21.153165 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3bc2b-23cc-4ab8-8ede-9f7ce08ddb96 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:21.166551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:21.167521 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:21.168032 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:21.168338 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] PATH_INFO: `/v3/projects/9b1767b15dc9450dbd074ee4025f443b/users/502bf813f2f64ce2958ddef443207a30/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:21.205105 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1767b15dc9450dbd074ee4025f443b, user_id=502bf813f2f64ce2958ddef443207a30, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:21.209048 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:21.227273 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1413/2816] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:21 2022] PUT /identity/v3/projects/9b1767b15dc9450dbd074ee4025f443b/users/502bf813f2f64ce2958ddef443207a30/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:07:21.232261 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:21.245374 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50132be8-2622-4e36-b55a-8136cf6490e4 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:21.314227 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dcc8e-f7ef-46d4-a8af-c1dd00562275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:21.314908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dcc8e-f7ef-46d4-a8af-c1dd00562275 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:21.315350 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dcc8e-f7ef-46d4-a8af-c1dd00562275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:21.315630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dcc8e-f7ef-46d4-a8af-c1dd00562275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:21.316417 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dcc8e-f7ef-46d4-a8af-c1dd00562275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:21.318068 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dcc8e-f7ef-46d4-a8af-c1dd00562275 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:21.328616 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1404/2817] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:07:21.332612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:21.342776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8d300-ed72-4ba5-8e90-72d55fc34f5e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:21.347476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:21.348400 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:21.348682 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:21.348955 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] PATH_INFO: `/v3/projects/9b1767b15dc9450dbd074ee4025f443b/users/502bf813f2f64ce2958ddef443207a30/roles/7adf0608488a4c0780e809cd640a911c` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:21.351010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1767b15dc9450dbd074ee4025f443b, user_id=502bf813f2f64ce2958ddef443207a30, role_id=7adf0608488a4c0780e809cd640a911c)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:21.353760 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:21.368602 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1414/2818] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:07:21 2022] PUT /identity/v3/projects/9b1767b15dc9450dbd074ee4025f443b/users/502bf813f2f64ce2958ddef443207a30/roles/7adf0608488a4c0780e809cd640a911c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:07:26.476513 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92817a-dacf-46dc-9880-7449e462f86e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:26.477020 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92817a-dacf-46dc-9880-7449e462f86e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:26.477131 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92817a-dacf-46dc-9880-7449e462f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:26.529909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-3d92817a-dacf-46dc-9880-7449e462f86e None None] MFA Rules not processed for user `502bf813f2f64ce2958ddef443207a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:26.531100 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3d92817a-dacf-46dc-9880-7449e462f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:26.617479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1405/2819] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:26.634579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:26.636931 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:26.715088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441bf7aa-c61c-4f5c-b752-ca69f1ce1d10 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:26.721326 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5126b-808b-45f5-8e51-6766b7fc0424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:26.721989 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5126b-808b-45f5-8e51-6766b7fc0424 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:26.722277 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5126b-808b-45f5-8e51-6766b7fc0424 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:26.722561 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5126b-808b-45f5-8e51-6766b7fc0424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:26.766751 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:26.784142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5126b-808b-45f5-8e51-6766b7fc0424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:26.785746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5126b-808b-45f5-8e51-6766b7fc0424 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:26.795217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1415/2820] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:27.839454 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:27.839911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:27.840072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:27.858225 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] MFA Rules not processed for user `9f42593700cb41408d258257c652f5b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:27.859451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:27.866522 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1406/2821] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:36.790802 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=8 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:36.922329 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:36.922629 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:36.922924 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:36.941397 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:36.942794 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:36.999003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1416/2822] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:07:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:37.047494 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:37.049208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:37.062733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:37.130590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562b073-7e93-424a-b2eb-858152a61491 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:37.135735 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc49f8e-03f8-4aaf-a7c1-6c00bf763384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:37.136449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49f8e-03f8-4aaf-a7c1-6c00bf763384 service swift] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:37.136734 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49f8e-03f8-4aaf-a7c1-6c00bf763384 service swift] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:37.137039 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49f8e-03f8-4aaf-a7c1-6c00bf763384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:37.145958 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc49f8e-03f8-4aaf-a7c1-6c00bf763384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:37.147705 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc49f8e-03f8-4aaf-a7c1-6c00bf763384 service swift] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:37.157156 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1407/2823] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:07:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:07:46.992006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=25 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:47.153000 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=29 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:07:51.807208 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:51.808686 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:51.879547 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395fe4-7a42-4259-8c36-8b226a203038 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:51.883463 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:51.884158 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:51.884447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:51.884733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:51.887653 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:51.961003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:51.962423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:51.973528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1417/2824] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:07:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:07:57.160351 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5153-a6b0-41d2-9316-50581523c97f None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:57.160814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5153-a6b0-41d2-9316-50581523c97f None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:57.160918 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5153-a6b0-41d2-9316-50581523c97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:57.178733 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-48ba5153-a6b0-41d2-9316-50581523c97f None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:07:57.179919 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-48ba5153-a6b0-41d2-9316-50581523c97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:07:57.187701 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1408/2825] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 10:07:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:07:57.199443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:07:57.211110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31341a8-97ed-4560-b6d6-6cce49272127 service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:07:57.216205 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:07:57.216841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:57.217122 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:57.217396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:07:57.225520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:07:57.227073 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:07:57.235461 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1418/2826] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:07:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 10:07:59.990361 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:07:59.990972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:07:59.990972 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.008501 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] MFA Rules not processed for user `b51e11f068d948a889871ce53ce29ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:00.009717 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:00.016764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1409/2827] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:07:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:00.206897 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:00.208384 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:00.286692 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e87d-52bf-4eea-8f29-74e1760b895d service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:00.291371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:00.292407 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:00.293276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:00.293276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] PATH_INFO: `/v3/users/9d071700ef004aa88715e0efa8915d6f` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.294406 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d071700ef004aa88715e0efa8915d6f)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:00.297080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:00.346276 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:00.350207 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d071700ef004aa88715e0efa8915d6f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.370556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d071700ef004aa88715e0efa8915d6f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.381660 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d071700ef004aa88715e0efa8915d6f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.394104 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d071700ef004aa88715e0efa8915d6f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.394850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-59338053-f26c-4b8a-b490-7ba02bead15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d071700ef004aa88715e0efa8915d6f'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.403703 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1419/2828] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:08:00 2022] DELETE /identity/v3/users/9d071700ef004aa88715e0efa8915d6f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:00.631905 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:00.644303 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e153-a9bf-46f0-bfed-841a664dbca2 None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:00.711451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:00.712806 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:00.713337 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:00.713839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] PATH_INFO: `/v3/projects/c8158e0b793e4ab39eb46f57cd27fda3` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.715315 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8158e0b793e4ab39eb46f57cd27fda3)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:00.718202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:00.768065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8158e0b793e4ab39eb46f57cd27fda3', 'request_id': 'req-f578f9d8-ed64-42f0-9936-7ed12902e9df'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.774133 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8158e0b793e4ab39eb46f57cd27fda3', 'request_id': 'req-f578f9d8-ed64-42f0-9936-7ed12902e9df'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.781428 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8158e0b793e4ab39eb46f57cd27fda3', 'request_id': 'req-f578f9d8-ed64-42f0-9936-7ed12902e9df'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.792460 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] The token cache is being invalidate because project c8158e0b793e4ab39eb46f57cd27fda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:08:00.792874 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.793553 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-f578f9d8-ed64-42f0-9936-7ed12902e9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:00.795091 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1410/2829] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:08:00 2022] DELETE /identity/v3/projects/c8158e0b793e4ab39eb46f57cd27fda3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:00.800494 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:00.800786 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:00.801119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.819351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:00.820658 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:00.882383 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1420/2830] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:08:00.890549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854747f8-435b-44dd-9171-88d1b343737e None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:00.890914 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854747f8-435b-44dd-9171-88d1b343737e None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:00.891259 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854747f8-435b-44dd-9171-88d1b343737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.909716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-854747f8-435b-44dd-9171-88d1b343737e None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:00.910922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-854747f8-435b-44dd-9171-88d1b343737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:00.919891 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1411/2831] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:00.924517 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:00.934199 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d411ae-20c7-49ee-af11-0396f264915a None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:00.939609 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:00.940292 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:00.940590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:00.940938 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.941738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80069) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:08:00.942106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:00.944052 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:00.959492 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1421/2832] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:08:00.960749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854747f8-435b-44dd-9171-88d1b343737e None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:00.970881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854747f8-435b-44dd-9171-88d1b343737e None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:00.976412 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:00.977426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:00.977426 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:00.977730 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:00.978432 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:00.980390 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:01.016661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1412/2833] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:08:00 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:08:01.020804 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:01.032520 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b9e4-57d1-4269-a208-283f912d7a8d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:01.135842 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:01.140631 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:01.141413 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:01.142234 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] PATH_INFO: `/v3/users` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:01.142850 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:01.145147 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:01.182062 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1422/2834] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:08:01 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:08:01.182291 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:01.193756 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f9332-5a03-432a-9c34-b97336953eab admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:01.198796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:01.199554 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:01.200791 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:01.201072 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:01.201860 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:01.203509 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:01.217489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1413/2835] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:08:01.219498 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:01.231257 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e456a-838b-46ed-8ed5-a543cf58d521 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:01.237770 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127c25b-7701-4ac4-9f04-1836995651ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:01.238466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127c25b-7701-4ac4-9f04-1836995651ba admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:01.238748 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127c25b-7701-4ac4-9f04-1836995651ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:01.239083 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127c25b-7701-4ac4-9f04-1836995651ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:01.239813 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127c25b-7701-4ac4-9f04-1836995651ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:01.241415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127c25b-7701-4ac4-9f04-1836995651ba admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:01.256371 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1423/2836] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:08:01.260979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:01.273953 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099cec1a-1ca4-4446-9148-9174b40082c8 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:01.279549 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:01.281125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] REQUEST_METHOD: `PUT` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:01.281405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:01.281680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] PATH_INFO: `/v3/projects/d8450f7ee85f409791927f526c43fc7b/users/d1a104ca7b184111b683d54e03abcb1f/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:01.301355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8450f7ee85f409791927f526c43fc7b, user_id=d1a104ca7b184111b683d54e03abcb1f, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:01.304138 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:01.318927 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1414/2837] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:08:01 2022] PUT /identity/v3/projects/d8450f7ee85f409791927f526c43fc7b/users/d1a104ca7b184111b683d54e03abcb1f/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:01.330988 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:01.331340 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:01.332314 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:01.369565 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] MFA Rules not processed for user `d1a104ca7b184111b683d54e03abcb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:01.370821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:01.390259 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:01.469969 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1424/2838] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:01.478321 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:01.480396 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:01.500088 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:01.565645 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6077c-75ca-43f9-8253-02c7dc587861 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:01.571614 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c7daa59378346bb9466961ea4c7c447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:01.573514 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:01.574271 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:01.575519 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:01.593624 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:01.595195 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:01.608035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1415/2839] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:04.316579 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:04.318025 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:04.400124 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ba0a2-c192-48c3-b1b4-4f69352bd68d None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:04.404251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:04.405613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:04.406003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:04.406376 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:04.408632 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:04.485358 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:04.486844 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15197acc-411a-47de-9d99-140ff24839fe service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:04.501220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1425/2840] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:11.602155 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=20 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:14.493894 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=70 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:33.788592 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:33.848629 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9943ea5e-dff1-406b-b050-0b903276b7db service glance] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:33.853047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:33.853895 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:33.854236 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:33.854450 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] PATH_INFO: `/v3/users/d1a104ca7b184111b683d54e03abcb1f` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:33.856305 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a104ca7b184111b683d54e03abcb1f)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:33.857523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:33.904181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a104ca7b184111b683d54e03abcb1f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:33.915773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a104ca7b184111b683d54e03abcb1f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:33.916479 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a104ca7b184111b683d54e03abcb1f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:33.923697 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a104ca7b184111b683d54e03abcb1f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:33.931545 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a104ca7b184111b683d54e03abcb1f'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:33.937380 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1416/2841] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:08:33 2022] DELETE /identity/v3/users/d1a104ca7b184111b683d54e03abcb1f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:33.942447 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:33.942942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:33.943046 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:33.960311 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:33.961516 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:34.019189 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1426/2842] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:34.028920 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.030357 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:34.086743 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bef3d-baa0-4497-966c-1da106ca28ba admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.090451 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c27ee-7372-4b39-b649-378f540aa20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.091089 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c27ee-7372-4b39-b649-378f540aa20a service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.091375 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c27ee-7372-4b39-b649-378f540aa20a service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.091651 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c27ee-7372-4b39-b649-378f540aa20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.101075 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c27ee-7372-4b39-b649-378f540aa20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.102500 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c27ee-7372-4b39-b649-378f540aa20a service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.112104 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1417/2843] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:34.378778 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.380239 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:34.395524 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a0683-af6b-4612-9431-7d521a71adb1 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.400142 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.401005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.401357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.401576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] PATH_INFO: `/v3/projects/d8450f7ee85f409791927f526c43fc7b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.402797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8450f7ee85f409791927f526c43fc7b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.404665 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.451101 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8450f7ee85f409791927f526c43fc7b', 'request_id': 'req-51eb1bf1-e884-47a8-82f4-8309c2307528'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:34.457067 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8450f7ee85f409791927f526c43fc7b', 'request_id': 'req-51eb1bf1-e884-47a8-82f4-8309c2307528'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:34.463907 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8450f7ee85f409791927f526c43fc7b', 'request_id': 'req-51eb1bf1-e884-47a8-82f4-8309c2307528'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:34.474457 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] The token cache is being invalidate because project d8450f7ee85f409791927f526c43fc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:08:34.474737 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:34.475350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-51eb1bf1-e884-47a8-82f4-8309c2307528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:34.476900 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1427/2844] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:08:34 2022] DELETE /identity/v3/projects/d8450f7ee85f409791927f526c43fc7b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:34.481656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.481939 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.482212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.500047 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:34.501231 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:34.520814 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:34.566698 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1418/2845] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:34.574415 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.574708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.575005 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.593614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:34.594815 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:34.603333 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1428/2846] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:34.607364 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.616957 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b37d-cd42-4fad-8042-00dbf3c28fac None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.622017 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.622659 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.622938 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.623212 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.624034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:08:34.624345 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.625961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.637377 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1419/2847] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:08:34.641537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.651180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526ba43-6bf0-4e08-b898-c7ea4b00bffe None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.655934 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.656597 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.656882 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.657160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.657841 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.660451 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.684840 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1429/2848] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:08:34 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:08:34.688924 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.698780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16ef1-a945-4dda-b7ed-4696e49ad3ae admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.754160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.754563 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.754837 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.755416 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.756223 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.758461 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.781447 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1420/2849] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:08:34 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:08:34.782510 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.793374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc237ee-8184-4f75-bb4d-a1109e000956 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.797913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.798581 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.798861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.799135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.799853 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.801456 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.811672 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1430/2850] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:08:34.815330 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.825208 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe933b4-4001-40f4-91c1-ed5ea49866fa admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.829829 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46675a1-68d5-4ee3-bb48-1e5e716e9bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.830468 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46675a1-68d5-4ee3-bb48-1e5e716e9bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.830748 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46675a1-68d5-4ee3-bb48-1e5e716e9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.831019 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46675a1-68d5-4ee3-bb48-1e5e716e9bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.832263 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46675a1-68d5-4ee3-bb48-1e5e716e9bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.833836 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46675a1-68d5-4ee3-bb48-1e5e716e9bfe admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.843556 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1421/2851] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:08:34.847370 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:34.857491 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302f06e-57fc-4b68-bebb-d8e46888563d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:34.862059 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:34.862920 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.863200 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.863476 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] PATH_INFO: `/v3/projects/3327ff90f88549d78123e40f648b3dde/users/197f63e87c54499bbae98fdf09fc55cc/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.877793 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3327ff90f88549d78123e40f648b3dde, user_id=197f63e87c54499bbae98fdf09fc55cc, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:34.883405 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:34.896043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1431/2852] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:08:34 2022] PUT /identity/v3/projects/3327ff90f88549d78123e40f648b3dde/users/197f63e87c54499bbae98fdf09fc55cc/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:08:34.906190 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:34.906483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:34.906764 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:34.933105 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] MFA Rules not processed for user `197f63e87c54499bbae98fdf09fc55cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:34.934304 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:34.998254 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1422/2853] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:35.009711 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:35.011458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:35.033953 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:35.069655 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e8e09-7389-4bfc-8e2b-d616f9dc0a86 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:35.073342 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5a3f4-fb4c-49fe-9ac0-91c0c4bb0b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:35.073974 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5a3f4-fb4c-49fe-9ac0-91c0c4bb0b91 service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.074251 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5a3f4-fb4c-49fe-9ac0-91c0c4bb0b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.074525 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5a3f4-fb4c-49fe-9ac0-91c0c4bb0b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.083343 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5a3f4-fb4c-49fe-9ac0-91c0c4bb0b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:35.084913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5a3f4-fb4c-49fe-9ac0-91c0c4bb0b91 service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:35.094091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1432/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:35.117714 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:35.137018 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:35.184092 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9f636-8f9a-4791-98df-0610a3a9d9ce None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:35.191299 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:35.192202 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.192490 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.192767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] PATH_INFO: `/v3/users/197f63e87c54499bbae98fdf09fc55cc` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.193970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=197f63e87c54499bbae98fdf09fc55cc)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:35.195872 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:35.240040 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197f63e87c54499bbae98fdf09fc55cc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.251732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197f63e87c54499bbae98fdf09fc55cc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.252463 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197f63e87c54499bbae98fdf09fc55cc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.259626 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197f63e87c54499bbae98fdf09fc55cc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.266123 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197f63e87c54499bbae98fdf09fc55cc'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.272732 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1423/2855] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:08:35 2022] DELETE /identity/v3/users/197f63e87c54499bbae98fdf09fc55cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:35.277385 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.277684 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.277971 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.294879 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:35.296087 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:35.354051 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1433/2856] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:35.364192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:35.365609 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:35.421980 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4c970-11c7-4d90-9e45-b821b59a3eef admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:35.426483 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca1587-b1a3-4e0e-8133-50d529c073f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:35.427126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1587-b1a3-4e0e-8133-50d529c073f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.427407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1587-b1a3-4e0e-8133-50d529c073f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.427680 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca1587-b1a3-4e0e-8133-50d529c073f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.437010 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca1587-b1a3-4e0e-8133-50d529c073f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:35.438437 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca1587-b1a3-4e0e-8133-50d529c073f2 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:35.448489 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1424/2857] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:35.711761 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:35.713217 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:35.725738 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80864b-d661-4ae3-9bcb-84c5c0ae8a2f None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:35.730350 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:35.731218 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.731505 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.731785 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] PATH_INFO: `/v3/projects/3327ff90f88549d78123e40f648b3dde` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.733010 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3327ff90f88549d78123e40f648b3dde)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:35.734932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:35.782620 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3327ff90f88549d78123e40f648b3dde', 'request_id': 'req-660c701a-a79e-4c7c-9be5-583964ad7704'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.789110 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3327ff90f88549d78123e40f648b3dde', 'request_id': 'req-660c701a-a79e-4c7c-9be5-583964ad7704'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.796055 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3327ff90f88549d78123e40f648b3dde', 'request_id': 'req-660c701a-a79e-4c7c-9be5-583964ad7704'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.806861 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] The token cache is being invalidate because project 3327ff90f88549d78123e40f648b3dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:08:35.807144 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.807765 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-660c701a-a79e-4c7c-9be5-583964ad7704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:35.809331 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1434/2858] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:08:35 2022] DELETE /identity/v3/projects/3327ff90f88549d78123e40f648b3dde => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:35.814111 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.814399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.814677 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.833881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:35.836067 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:35.873974 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:35.901630 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1425/2859] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:35.911466 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.911776 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.912171 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.930832 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:35.932065 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:35.939883 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1435/2860] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:35.944277 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:35.954283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ad08-c8e1-4c9b-8f47-30a6e5e1e4be None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:35.958839 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:35.959476 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.959755 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.960074 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.960817 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:08:35.961126 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:35.962690 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:35.974650 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1426/2861] 10.222.0.36 () {58 vars in 1152 bytes} [Tue Jun 21 10:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:08:35.978958 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:35.988532 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882917ab-5cb3-47f8-a17e-72de2031fc75 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:35.993243 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:35.994153 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:35.994432 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:35.994704 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:35.995396 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:35.997323 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:36.021661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1436/2862] 10.222.0.36 () {60 vars in 1152 bytes} [Tue Jun 21 10:08:35 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:08:36.025797 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:36.036031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda9288-c39c-4cb6-a8e9-7b77dc75ff9d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:36.090773 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:36.091687 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:36.091992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:36.092283 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] PATH_INFO: `/v3/users` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:36.092979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:36.094937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:36.115511 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1427/2863] 10.222.0.36 () {60 vars in 1143 bytes} [Tue Jun 21 10:08:36 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:08:36.119820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:36.130085 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e7078-1db0-4a7b-b580-d423b35e5832 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:36.134634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:36.135275 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:36.135556 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:36.135829 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] PATH_INFO: `/v3/roles` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:36.136590 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:36.138166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:36.149019 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1437/2864] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:08:36.152979 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:36.167858 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983d1d3-b0b4-4348-acce-52650695ca94 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:36.172848 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c4025-545c-4fd0-bb6c-be676a7b72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:36.173542 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4025-545c-4fd0-bb6c-be676a7b72a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:36.173824 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4025-545c-4fd0-bb6c-be676a7b72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:36.174099 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4025-545c-4fd0-bb6c-be676a7b72a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:36.174842 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c4025-545c-4fd0-bb6c-be676a7b72a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:36.177170 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c4025-545c-4fd0-bb6c-be676a7b72a7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:36.189021 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1428/2865] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Jun 21 10:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:08:36.207831 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:36.217856 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408beb0a-4bdd-4075-b0ce-6cb4dc5fa71a admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:36.222949 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:36.223818 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:36.224135 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:36.224412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] PATH_INFO: `/v3/projects/4fcb310999794e8ba3142f4eff71ca99/users/79f82093f8cd46e59d5e8921738ad955/roles/423552284f2a4983b5eef8fc699e5515` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:36.226582 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:36.241209 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fcb310999794e8ba3142f4eff71ca99, user_id=79f82093f8cd46e59d5e8921738ad955, role_id=423552284f2a4983b5eef8fc699e5515)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:36.244094 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:36.256538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1438/2866] 10.222.0.36 () {60 vars in 1482 bytes} [Tue Jun 21 10:08:36 2022] PUT /identity/v3/projects/4fcb310999794e8ba3142f4eff71ca99/users/79f82093f8cd46e59d5e8921738ad955/roles/423552284f2a4983b5eef8fc699e5515 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:36.266449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22628652-9b6f-4f9a-a051-754fb2266598 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:36.266749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22628652-9b6f-4f9a-a051-754fb2266598 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:36.267057 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22628652-9b6f-4f9a-a051-754fb2266598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:36.294031 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-22628652-9b6f-4f9a-a051-754fb2266598 None None] MFA Rules not processed for user `79f82093f8cd46e59d5e8921738ad955`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:36.295238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-22628652-9b6f-4f9a-a051-754fb2266598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:36.357197 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1429/2867] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:36.367812 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:36.369723 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:36.424617 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4b402-94a1-452c-a07c-837a7857bd0e admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:36.428613 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb8e8cab0c654fc39a73caa7c718ae56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:36.429256 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:36.429541 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:36.429820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:36.438089 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:36.439511 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:36.448754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1439/2868] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:37.783845 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86530d9-e95e-4188-a857-e436adb0163c None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:37.784383 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86530d9-e95e-4188-a857-e436adb0163c None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:37.784505 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86530d9-e95e-4188-a857-e436adb0163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:37.802159 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-d86530d9-e95e-4188-a857-e436adb0163c None None] MFA Rules not processed for user `79f82093f8cd46e59d5e8921738ad955`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:37.803355 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-d86530d9-e95e-4188-a857-e436adb0163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:37.810181 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1430/2869] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:46.444819 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:47.796981 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:49.811874 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:49.813302 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:49.870440 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef948445-bb05-4209-b402-f0390975965f service cinder] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:49.874035 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:49.874718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:49.874963 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:49.875240 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:49.877003 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:49.947310 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:49.948847 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:49.961071 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1440/2870] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:53.803922 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77db88-394c-4f5d-bc07-67883b2234df None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:53.804411 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77db88-394c-4f5d-bc07-67883b2234df None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:53.804515 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77db88-394c-4f5d-bc07-67883b2234df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:53.821834 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-5d77db88-394c-4f5d-bc07-67883b2234df None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:53.823073 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-5d77db88-394c-4f5d-bc07-67883b2234df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:53.876578 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1431/2871] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:08:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:53.897351 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:53.898754 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:53.965287 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5af4b0-6952-489d-a72e-63c0cf0af187 service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:53.970190 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:53.970821 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:53.971102 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:53.971379 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:53.979771 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:53.981372 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:53.989236 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1441/2872] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:08:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:08:54.478276 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc892f1-b87a-4305-b9e3-99283949af7a None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:54.478598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc892f1-b87a-4305-b9e3-99283949af7a None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:54.478992 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc892f1-b87a-4305-b9e3-99283949af7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:54.496894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ecc892f1-b87a-4305-b9e3-99283949af7a None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:54.498085 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ecc892f1-b87a-4305-b9e3-99283949af7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:54.505180 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1432/2873] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:54.518423 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:54.529718 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0076-f01e-46b5-acf5-447c7bc7675c service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:54.534634 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:54.535258 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:54.535538 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:54.535814 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:54.543668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:54.545269 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:54.553143 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1442/2874] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:08:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:08:54.735425 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881942c-59e4-4318-985b-e7b892d27fb4 None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:54.735716 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881942c-59e4-4318-985b-e7b892d27fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:54.736034 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881942c-59e4-4318-985b-e7b892d27fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:54.754070 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-f881942c-59e4-4318-985b-e7b892d27fb4 None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:54.755256 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f881942c-59e4-4318-985b-e7b892d27fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:54.762896 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1433/2875] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Jun 21 10:08:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:54.774264 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:54.784708 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233c3d4-6e30-4396-9df7-7883989ab7fd service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:54.789627 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:54.790249 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:54.790531 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:54.790835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:54.798877 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:54.800460 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:54.808797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1443/2876] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:08:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:08:55.117407 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] REQUEST_METHOD: `POST` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:55.117830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:55.117950 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:55.135726 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.auth.core [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] MFA Rules not processed for user `125703637f434bc5b425cc979de91263`. Rule list: `[]` (Enabled: `True`). {{(pid=80068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:55.136971 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:55.144108 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1434/2877] 10.222.0.36 () {58 vars in 967 bytes} [Tue Jun 21 10:08:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:55.155679 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:55.162535 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:55.166828 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83f0cb-9691-47d5-ad63-b820a8e3527c service swift] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:55.172289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91308637-9582-4c52-8b07-d5420d989bcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f250dc336cc47a0ba8dd4c66ce717ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:55.173088 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91308637-9582-4c52-8b07-d5420d989bcd service swift] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:55.173374 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91308637-9582-4c52-8b07-d5420d989bcd service swift] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:55.173649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91308637-9582-4c52-8b07-d5420d989bcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:55.182319 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91308637-9582-4c52-8b07-d5420d989bcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:55.183872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91308637-9582-4c52-8b07-d5420d989bcd service swift] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:55.191717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1444/2878] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Jun 21 10:08:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:08:57.220334 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:57.289818 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae9a8c-1716-435d-979c-37404d8b2dfd None None] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:57.294314 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:57.295183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:57.295516 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:57.295796 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] PATH_INFO: `/v3/users/79f82093f8cd46e59d5e8921738ad955` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:57.297013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f82093f8cd46e59d5e8921738ad955)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:57.298926 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:57.345270 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f82093f8cd46e59d5e8921738ad955'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.357635 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f82093f8cd46e59d5e8921738ad955'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.358288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f82093f8cd46e59d5e8921738ad955'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.365035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f82093f8cd46e59d5e8921738ad955'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.372596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f82093f8cd46e59d5e8921738ad955'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.378805 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1435/2879] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:08:57 2022] DELETE /identity/v3/users/79f82093f8cd46e59d5e8921738ad955 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:08:57.384151 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] REQUEST_METHOD: `POST` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:57.384640 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:57.384746 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:57.402452 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.auth.core [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] MFA Rules not processed for user `80104af4696c44369cc93327cb4e59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80069) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:08:57.403644 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:57.460334 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1445/2880] 10.222.0.36 () {58 vars in 957 bytes} [Tue Jun 21 10:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:08:57.469767 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:57.471160 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:57.477750 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:08:57.532096 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d5f7-bb4e-4444-a66a-38a9cfdd9048 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:57.535729 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:57.536399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:57.536688 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:57.536964 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:57.545908 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:57.547325 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:57.556588 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1436/2881] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:08:57.731006 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:08:57.732458 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:08:57.745180 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e8238-3c06-4123-abf9-0685a3a8f2d6 None None] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:08:57.749727 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:08:57.750588 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:08:57.750873 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:08:57.751477 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] PATH_INFO: `/v3/projects/4fcb310999794e8ba3142f4eff71ca99` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:08:57.752705 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fcb310999794e8ba3142f4eff71ca99)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:08:57.754601 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:08:57.801220 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fcb310999794e8ba3142f4eff71ca99', 'request_id': 'req-e6397dab-9784-4342-8c1c-34a94ec6158d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.807820 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fcb310999794e8ba3142f4eff71ca99', 'request_id': 'req-e6397dab-9784-4342-8c1c-34a94ec6158d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.814895 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fcb310999794e8ba3142f4eff71ca99', 'request_id': 'req-e6397dab-9784-4342-8c1c-34a94ec6158d'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.825664 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] The token cache is being invalidate because project 4fcb310999794e8ba3142f4eff71ca99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:08:57.825948 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.826562 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:08:57.828119 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1446/2882] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:08:57 2022] DELETE /identity/v3/projects/4fcb310999794e8ba3142f4eff71ca99 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:09:07.552466 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=24 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:09:07.822763 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:09:47.766329 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:09:47.767781 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:09:47.778944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85fec-1d9a-4fff-b0c6-29b3f4c2d25c service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:09:47.826373 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:09:47.827005 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:09:47.827288 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:09:47.827567 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:09:47.829340 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:09:47.838472 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:09:47.839873 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:09:47.847749 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1437/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:09:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:09:57.844238 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=26 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:05.466523 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:05.468855 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:05.559166 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397dab-9784-4342-8c1c-34a94ec6158d admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:05.564876 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:05.565593 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:05.565835 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:05.566106 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:05.567913 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:05.588116 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:05.589649 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:05.601576 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1447/2884] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:05.646673 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:05.648183 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:05.658799 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302d99-b56c-43f2-aa2c-c2849a76af65 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:05.662642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:05.663359 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:05.663708 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:05.664121 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:05.665985 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:05.679612 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:05.681702 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:05.693135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1438/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:13.452838 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:13.454288 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:13.468701 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce2959-f174-47c4-8a47-5b20c16fc21c service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:13.474231 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:13.474885 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:13.475167 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:13.475444 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:13.477274 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:13.489717 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:13.491284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:13.503028 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1448/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:15.687929 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=6 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:19.028235 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:19.036856 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611320f-b3ef-417b-9d64-f0998cc18213 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:19.041065 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:19.041798 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:19.042894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:19.042894 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:19.044157 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:19.110909 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:19.112387 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:19.122066 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1439/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:22.306646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:22.308399 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:22.412797 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafeb91-458d-468d-bae9-d4ec5ebb3a04 service nova] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:22.418872 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:22.419594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:22.419940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:22.420298 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:22.422176 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:22.434668 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:22.436289 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:22.447903 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1449/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:25.503035 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:25.505206 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:25.519449 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c255d-328c-4de4-b442-660c6e1592b5 service neutron] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:25.524878 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:25.525758 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:25.526037 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:25.526311 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] PATH_INFO: `/v3/users/b51e11f068d948a889871ce53ce29ceb` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:25.527523 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b51e11f068d948a889871ce53ce29ceb)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:25.529493 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:25.577719 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b51e11f068d948a889871ce53ce29ceb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.589993 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b51e11f068d948a889871ce53ce29ceb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.590684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b51e11f068d948a889871ce53ce29ceb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.597497 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b51e11f068d948a889871ce53ce29ceb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.603901 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b51e11f068d948a889871ce53ce29ceb'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.610217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1440/2889] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:10:25 2022] DELETE /identity/v3/users/b51e11f068d948a889871ce53ce29ceb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:10:25.820506 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:25.832308 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735cfca-0803-4e3d-b6e3-e5500aad8903 service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:25.904551 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:25.905428 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:25.905706 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:25.905985 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] PATH_INFO: `/v3/projects/95b4310d4b154732b31c773044f56154` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:25.907170 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b4310d4b154732b31c773044f56154)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:25.909123 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:25.911594 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=100 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:25.958412 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b4310d4b154732b31c773044f56154', 'request_id': 'req-239c155c-533a-45f2-9ffc-5a2cd7250264'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.965173 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b4310d4b154732b31c773044f56154', 'request_id': 'req-239c155c-533a-45f2-9ffc-5a2cd7250264'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.973156 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b4310d4b154732b31c773044f56154', 'request_id': 'req-239c155c-533a-45f2-9ffc-5a2cd7250264'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.985036 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] The token cache is being invalidate because project 95b4310d4b154732b31c773044f56154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:10:25.985324 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.985961 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:25.987522 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1450/2890] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:10:25 2022] DELETE /identity/v3/projects/95b4310d4b154732b31c773044f56154 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:10:25.991667 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:25.993661 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.008192 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a164-1ddf-4945-a1d8-14fd4fe6d28d admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:26.028859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:26.030394 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.075897 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:26.076822 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:26.077102 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:26.077560 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] PATH_INFO: `/v3/users/7296e902ec604e3bbd5b6026f6cec6f9` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:26.078780 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7296e902ec604e3bbd5b6026f6cec6f9)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:26.080741 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:26.092410 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:26.098849 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c155c-533a-45f2-9ffc-5a2cd7250264 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:26.104093 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:26.105148 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:26.105436 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:26.106714 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:26.110049 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.123284 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:26.124942 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:26.135823 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1451/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:10:26.150397 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7296e902ec604e3bbd5b6026f6cec6f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.166771 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7296e902ec604e3bbd5b6026f6cec6f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.167400 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7296e902ec604e3bbd5b6026f6cec6f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.176627 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7296e902ec604e3bbd5b6026f6cec6f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.184286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7296e902ec604e3bbd5b6026f6cec6f9'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.190204 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1441/2892] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:10:25 2022] DELETE /identity/v3/users/7296e902ec604e3bbd5b6026f6cec6f9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:10:26.215345 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:26.216702 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.226972 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf678d52-cde0-43e7-9b67-3233be848d7f service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:26.278950 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea057364d054564b4c44f7a5d60f94b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:26.279614 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:26.279901 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:26.280226 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:26.282362 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.330817 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:26.358352 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:26.359805 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:26.372520 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:26.373215 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1452/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:26.374260 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.441160 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:26.442595 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.457664 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36f411-c0d1-4b7a-97a3-992615249c34 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:26.462480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:26.463347 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:26.463633 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:26.463911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] PATH_INFO: `/v3/projects/94f946129dfc456583a41cac64b43373` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:26.465142 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f946129dfc456583a41cac64b43373)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:26.467117 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:26.513906 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd7469-6438-4b23-ac95-9e3c8838733d service neutron] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:26.514125 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f946129dfc456583a41cac64b43373', 'request_id': 'req-831d8d00-7278-41c2-9882-a0d8b749cb14'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.520372 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f946129dfc456583a41cac64b43373', 'request_id': 'req-831d8d00-7278-41c2-9882-a0d8b749cb14'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.528294 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f946129dfc456583a41cac64b43373', 'request_id': 'req-831d8d00-7278-41c2-9882-a0d8b749cb14'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.539302 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] The token cache is being invalidate because project 94f946129dfc456583a41cac64b43373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80068) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:10:26.539590 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.540253 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:10:26.541801 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1442/2894] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:10:26 2022] DELETE /identity/v3/projects/94f946129dfc456583a41cac64b43373 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:10:26.581773 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:26.582450 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:26.582735 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:26.583011 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:26.584983 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:26.597555 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:26.599422 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:26.611043 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1453/2895] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:10:27.876970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:10:27.878506 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:27.903804 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:27.965435 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d8d00-7278-41c2-9882-a0d8b749cb14 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:10:27.970986 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947e9ae8d1a44654b3c294b849912707', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:10:27.971642 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:10:27.971928 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:10:27.972246 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:10:27.974013 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:10:27.993811 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:10:27.995405 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:10:28.006346 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1443/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:10:36.605979 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=69 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:10:38.001510 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=27 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:13.217956 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:12:13.219443 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:13.270151 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:12:13.271709 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:13.346033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5241af7-1539-4294-86ab-99cf42cc05bd service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:12:13.351568 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:12:13.352305 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] REQUEST_METHOD: `GET` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:12:13.352661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:12:13.352859 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:12:13.354827 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:13.368033 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:12:13.369618 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:12:13.380518 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1454/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:12:13.418402 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c23c6-f950-4617-81b8-c57db5e57a67 service nova] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:12:13.423015 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:12:13.423881 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:12:13.424198 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:12:13.424477 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] PATH_INFO: `/v3/users/9f42593700cb41408d258257c652f5b7` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:12:13.425669 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f42593700cb41408d258257c652f5b7)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:12:13.427568 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:12:13.475564 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f42593700cb41408d258257c652f5b7'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.486944 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f42593700cb41408d258257c652f5b7'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.487598 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f42593700cb41408d258257c652f5b7'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.494656 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f42593700cb41408d258257c652f5b7'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.502286 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f42593700cb41408d258257c652f5b7'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.508241 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1444/2898] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:12:13 2022] DELETE /identity/v3/users/9f42593700cb41408d258257c652f5b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:12:13.676572 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:12:13.689050 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fc1e9-127d-4985-bdd9-b7df7e93ac19 service placement] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:12:13.744798 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:12:13.746248 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:12:13.746528 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:12:13.746803 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] PATH_INFO: `/v3/projects/dff115ce08e947c29313f5019cf568fd` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:12:13.747995 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff115ce08e947c29313f5019cf568fd)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:12:13.749932 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:12:13.793612 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff115ce08e947c29313f5019cf568fd', 'request_id': 'req-11a54f5c-08fc-4eec-8675-2a8f20c89582'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.799503 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff115ce08e947c29313f5019cf568fd', 'request_id': 'req-11a54f5c-08fc-4eec-8675-2a8f20c89582'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.806537 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff115ce08e947c29313f5019cf568fd', 'request_id': 'req-11a54f5c-08fc-4eec-8675-2a8f20c89582'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.816646 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] The token cache is being invalidate because project dff115ce08e947c29313f5019cf568fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:12:13.816933 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.817610 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.819121 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1455/2899] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:12:13 2022] DELETE /identity/v3/projects/dff115ce08e947c29313f5019cf568fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:12:13.823580 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:12:13.825044 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:13.837636 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6be17-b7b9-472b-844d-d1f3143e3cf7 admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:12:13.849970 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:13.894536 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:12:13.895399 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:12:13.895684 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:12:13.895961 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] PATH_INFO: `/v3/users/502bf813f2f64ce2958ddef443207a30` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:12:13.897158 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] RBAC: Authorizing `identity:delete_user(user_id=502bf813f2f64ce2958ddef443207a30)` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:12:13.899058 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:12:13.943574 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502bf813f2f64ce2958ddef443207a30'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.955480 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502bf813f2f64ce2958ddef443207a30'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.956189 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502bf813f2f64ce2958ddef443207a30'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.962976 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502bf813f2f64ce2958ddef443207a30'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.970191 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.notifications [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502bf813f2f64ce2958ddef443207a30'} {{(pid=80068) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:13.975911 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1445/2900] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Jun 21 10:12:13 2022] DELETE /identity/v3/users/502bf813f2f64ce2958ddef443207a30 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:12:14.144733 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Authenticating user token {{(pid=80069) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:12:14.146183 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.fernet_utils [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80069) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:14.158947 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a54f5c-08fc-4eec-8675-2a8f20c89582 admin admin] Validating token access rules against request {{(pid=80069) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:12:14.164195 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:14.221080 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80104af4696c44369cc93327cb4e59bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f168e0b349b4ecc9d941ccf0785ad5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80069) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:12:14.221940 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:12:14.222227 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:12:14.222508 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] PATH_INFO: `/v3/projects/9b1767b15dc9450dbd074ee4025f443b` {{(pid=80069) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:12:14.223696 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1767b15dc9450dbd074ee4025f443b)` {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:12:14.225661 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] RBAC: Authorization granted {{(pid=80069) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:12:14.272069 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1767b15dc9450dbd074ee4025f443b', 'request_id': 'req-525246d6-34b3-46da-9377-5aef929177bd'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:14.278091 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1767b15dc9450dbd074ee4025f443b', 'request_id': 'req-525246d6-34b3-46da-9377-5aef929177bd'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:14.285316 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1767b15dc9450dbd074ee4025f443b', 'request_id': 'req-525246d6-34b3-46da-9377-5aef929177bd'} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:14.295364 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] The token cache is being invalidate because project 9b1767b15dc9450dbd074ee4025f443b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80069) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:12:14.295647 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:14.296357 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG keystone.notifications [None req-525246d6-34b3-46da-9377-5aef929177bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80069) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:12:14.298141 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: [pid: 80069|app: 0|req: 1456/2901] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Jun 21 10:12:14 2022] DELETE /identity/v3/projects/9b1767b15dc9450dbd074ee4025f443b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:12:23.972422 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:24.292441 dv-cinder-806605-4-iscsi devstack@keystone.service[80069]: DEBUG dbcounter [-] [80069] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80069) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:12:56.047312 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Authenticating user token {{(pid=80068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:12:56.048738 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:56.120596 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d6301-13a9-480f-a5e8-7fdb3093effb admin admin] Validating token access rules against request {{(pid=80068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:12:56.177135 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '794d74faad1d449e8a4253b21f01e050', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '660aaf4d825d4d29af5f2522f64a3daa', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:12:56.177769 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] REQUEST_METHOD: `GET` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:12:56.178049 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] SCRIPT_NAME: `/identity` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:12:56.178324 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:12:56.180116 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.fernet_utils [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:12:56.190830 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:12:56.192423 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afaa21-14e4-45a0-be96-29847d630ad1 service placement] RBAC: Authorization granted {{(pid=80068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:12:56.202217 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: [pid: 80068|app: 0|req: 1446/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Jun 21 10:12:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:13:06.197937 dv-cinder-806605-4-iscsi devstack@keystone.service[80068]: DEBUG dbcounter [-] [80068] Writing DB stats keystone:SELECT=58 {{(pid=80068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}